Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions changelog.d/+dev-envrc.feature.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
`eb-local dev --envrc MODULE...` writes the line that evaluates that `dev` to `.envrc` in the working directory, between marker lines it owns, and updates it on a later run without touching other lines. With direnv the build environment then follows the directory, in every shell direnv has a hook for.
18 changes: 15 additions & 3 deletions docs/orgmode/reference/cli.org
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ eb-local [OPTION]... --explain <easyconfig> [eb options]
eb-local eb [--] [eb options]
eb-local --explain eb [--] [eb options]
eb-local [OPTION]... env [--strict] [--json]
eb-local [OPTION]... dev [--strict] [--json] [--buildenv MODULE] [MODULE...]
eb-local [OPTION]... dev [--strict] [--json] [--buildenv MODULE] [--envrc] [MODULE...]
eb-local rpath-wrappers [--for FAMILY | --unwrapped]
eb-local check [--recursive] [--quiet] [--json] FILE...
eb-local check (--module NAME/VERSION... | --dev | --prefix DIR) [--recursive] [--quiet] [--json]
Expand Down Expand Up @@ -60,13 +60,14 @@ directory you own.
eb-local env [--strict] [--json] lines that make your installed modules visible;
--strict exits when the EESSI init file is missing
(also when EB_LOCAL_ENV_STRICT=1)
eb-local dev [--strict] [--json] [--buildenv MODULE] [MODULE...]
eb-local dev [--strict] [--json] [--buildenv MODULE] [--envrc] [MODULE...]
the same, plus MODULEs and a build environment,
so gcc, make, cmake and meson just work;
--strict exits when the EESSI init file is missing
(also when EB_LOCAL_ENV_STRICT=1);
--buildenv names the build environment to load;
--json prints the change as JSON, for env too
--json prints the change as JSON, for env too;
--envrc writes that line to .envrc for direnv
eb-local rpath-wrappers [--for FAMILY | --unwrapped]
lines that put RPATH wrappers for the compilers
on PATH first; dev uses them when no build
Expand Down Expand Up @@ -319,6 +320,17 @@ Print the lines =env= prints, then the lines that load the modules =dev.modules=
| =--strict= | Check that the EESSI init file exists in the emitted lines and exit 2 if absent (also when =EB_LOCAL_ENV_STRICT=1=). |
| =--json= | Print the change the lines make to the environment as one line of JSON, as =env --json= does, with =kind= =dev=. |
| =--buildenv MODULE= | Load MODULE as the build environment whatever the compilers, as =dev.buildenv= does. |
| =--envrc= | Write the line that evaluates this =dev= to =.envrc= in the working directory, for direnv, and print nothing on stdout. |

=dev --envrc MODULE...= writes three lines to =.envrc=:

#+begin_src sh
# >>> eb-local dev >>> rerun `eb-local dev --envrc` to change these lines
eval "$(/path/to/eb-local dev MODULE...)"
# <<< eb-local dev <<<
#+end_src

The program is named by its own path, and =--config=, =--profile=, =--project= and =--buildenv= are repeated on the line. A block already in the file is replaced and every other line is kept; a file without one gets it appended. A begin line without its end line is refused. Run =direnv allow= once per change. direnv evaluates the file in bash and gives the calling shell the change, so the environment follows the directory in bash, zsh, fish, nushell and the other shells direnv has a hook for, and is taken back on leaving it. As with =--json=, only variables reach the calling shell.

A =MODULE= starts with a letter or digit and holds letters, digits, =.=, =_=, =+=, =-= and single slashes, with none at the end.
With =LD_LIBRARY_PATH= set in the shell, =dev= warns on stderr.
Expand Down
18 changes: 15 additions & 3 deletions docs/reference/cli.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ eb-local [OPTION]... --explain <easyconfig> [eb options]
eb-local eb [--] [eb options]
eb-local --explain eb [--] [eb options]
eb-local [OPTION]... env [--strict] [--json]
eb-local [OPTION]... dev [--strict] [--json] [--buildenv MODULE] [MODULE...]
eb-local [OPTION]... dev [--strict] [--json] [--buildenv MODULE] [--envrc] [MODULE...]
eb-local rpath-wrappers [--for FAMILY | --unwrapped]
eb-local check [--recursive] [--quiet] [--json] FILE...
eb-local check (--module NAME/VERSION... | --dev | --prefix DIR) [--recursive] [--quiet] [--json]
Expand Down Expand Up @@ -62,13 +62,14 @@ directory you own.
eb-local env [--strict] [--json] lines that make your installed modules visible;
--strict exits when the EESSI init file is missing
(also when EB_LOCAL_ENV_STRICT=1)
eb-local dev [--strict] [--json] [--buildenv MODULE] [MODULE...]
eb-local dev [--strict] [--json] [--buildenv MODULE] [--envrc] [MODULE...]
the same, plus MODULEs and a build environment,
so gcc, make, cmake and meson just work;
--strict exits when the EESSI init file is missing
(also when EB_LOCAL_ENV_STRICT=1);
--buildenv names the build environment to load;
--json prints the change as JSON, for env too
--json prints the change as JSON, for env too;
--envrc writes that line to .envrc for direnv
eb-local rpath-wrappers [--for FAMILY | --unwrapped]
lines that put RPATH wrappers for the compilers
on PATH first; dev uses them when no build
Expand Down Expand Up @@ -321,6 +322,17 @@ Print the lines `env` prints, then the lines that load the modules `dev.modules`
| `--strict` | Check that the EESSI init file exists in the emitted lines and exit 2 if absent (also when `EB_LOCAL_ENV_STRICT=1`). |
| `--json` | Print the change the lines make to the environment as one line of JSON, as `env --json` does, with `kind` `dev`. |
| `--buildenv MODULE` | Load MODULE as the build environment whatever the compilers, as `dev.buildenv` does. |
| `--envrc` | Write the line that evaluates this `dev` to `.envrc` in the working directory, for direnv, and print nothing on stdout. |

`dev --envrc MODULE...` writes three lines to `.envrc`:

```sh
# >>> eb-local dev >>> rerun `eb-local dev --envrc` to change these lines
eval "$(/path/to/eb-local dev MODULE...)"
# <<< eb-local dev <<<
```

The program is named by its own path, and `--config`, `--profile`, `--project` and `--buildenv` are repeated on the line. A block already in the file is replaced and every other line is kept; a file without one gets it appended. A begin line without its end line is refused. Run `direnv allow` once per change. direnv evaluates the file in bash and gives the calling shell the change, so the environment follows the directory in bash, zsh, fish, nushell and the other shells direnv has a hook for, and is taken back on leaving it. As with `--json`, only variables reach the calling shell.

A `MODULE` starts with a letter or digit and holds letters, digits, `.`, `_`, `+`, `-` and single slashes, with none at the end.
With `LD_LIBRARY_PATH` set in the shell, `dev` warns on stderr.
Expand Down
55 changes: 53 additions & 2 deletions src/main.zig
Original file line number Diff line number Diff line change
Expand Up @@ -65,13 +65,14 @@ const usage_text =
\\ eb-local env [--strict] [--json] lines that make your installed modules visible;
\\ --strict exits when the EESSI init file is missing
\\ (also when EB_LOCAL_ENV_STRICT=1)
\\ eb-local dev [--strict] [--json] [--buildenv MODULE] [MODULE...]
\\ eb-local dev [--strict] [--json] [--buildenv MODULE] [--envrc] [MODULE...]
\\ the same, plus MODULEs and a build environment,
\\ so gcc, make, cmake and meson just work;
\\ --strict exits when the EESSI init file is missing
\\ (also when EB_LOCAL_ENV_STRICT=1);
\\ --buildenv names the build environment to load;
\\ --json prints the change as JSON, for env too
\\ --json prints the change as JSON, for env too;
\\ --envrc writes that line to .envrc for direnv
\\ eb-local rpath-wrappers [--for FAMILY | --unwrapped]
\\ lines that put RPATH wrappers for the compilers
\\ on PATH first; dev uses them when no build
Expand Down Expand Up @@ -477,6 +478,8 @@ const Global = struct {
env_strict: bool = false,
/// One line of JSON on stdout instead of the human report.
json_out: bool = false,
/// `dev --envrc`: write the dev line to `.envrc` here, for direnv.
envrc: bool = false,
};

fn nonEmpty(v: ?[]const u8) ?[]const u8 {
Expand Down Expand Up @@ -688,6 +691,51 @@ fn cmdEnv(c: Ctx, s: config.Settings, g: Global) u8 {
return 0;
}

/// The first and last line of the lines `dev --envrc` owns in `.envrc`.
/// What stands outside them is the user's and is kept.
const envrc_begin = "# >>> eb-local dev >>>";
const envrc_end = "# <<< eb-local dev <<<";

/// Write `eval "$(eb-local WORDS)"` between the markers of `.envrc` in the
/// working directory, for direnv: it evaluates the file in bash and gives the
/// calling shell the change, whatever that shell is, and takes it back on
/// leaving the directory. A block already there is replaced; other lines
/// stay. The program is named by its own path, since a shell that direnv
/// starts need not have eb-local on PATH.
fn writeEnvrc(c: Ctx, words: []const u8) u8 {
const a = c.a;
var buf: [sys.path_max]u8 = undefined;
const exe = selfExe(&buf) orelse "eb-local";
const block = str(a, "{s} rerun `eb-local dev --envrc` to change these lines\neval \"$({s} {s})\"\n{s}\n", .{ envrc_begin, q(a, exe), words, envrc_end });
var exists_already = false;
const old: []const u8 = if (fsx.openRegular(fsx.cwd, ".envrc", true)) |opened| blk: {
defer sys.close(opened.fd);
exists_already = true;
break :blk fsx.readAll(a, opened.fd, 1 << 20) catch |e| die("cannot read .envrc ({s})", .{@errorName(e)});
} else |_| "";
const text = if (std.mem.indexOf(u8, old, envrc_begin)) |at| blk: {
const rest = std.mem.indexOfPos(u8, old, at, envrc_end) orelse
die(".envrc has `{s}` without `{s}`; remove that line or add the end line, then run this again", .{ envrc_begin, envrc_end });
var end = rest + envrc_end.len;
if (end < old.len and old[end] == '\n') end += 1;
break :blk str(a, "{s}{s}{s}", .{ old[0..at], block, old[end..] });
} else if (old.len == 0)
block
else
str(a, "{s}{s}{s}", .{ old, if (old[old.len - 1] == '\n') "" else "\n", block });
if (exists_already) {
// Written beside the old file and renamed over it, with its mode.
fsx.replaceContents(a, fsx.cwd, ".envrc", text) catch |e| die("cannot write .envrc ({s})", .{@errorName(e)});
} else {
const fd = sys.openat(fsx.cwd, ".envrc", .{ .ACCMODE = .WRONLY, .CREAT = true, .EXCL = true, .NOFOLLOW = true }, 0o644) catch |e|
die("cannot create .envrc ({s})", .{@errorName(e)});
defer sys.close(fd);
sys.writeAll(fd, text) catch |e| die("cannot write .envrc ({s})", .{@errorName(e)});
}
cli.err("eb-local: wrote .envrc in {s}; run `direnv allow` there to load it\n", .{c.cwd});
return 0;
}

fn cmdDev(c: Ctx, s: config.Settings, g: Global, extra: []const []const u8) u8 {
const a = c.a;
// A module is loaded once, where it is first named; a chosen build
Expand All @@ -702,6 +750,7 @@ fn cmdDev(c: Ctx, s: config.Settings, g: Global, extra: []const []const u8) u8 {
} else mods.append(a, m) catch oom();
};
const installed = place(c, s);
if (g.envrc) return writeEnvrc(c, replay(a, "dev", s, g, installed.prefix, extra));
if (!g.json_out) evalHint(replay(a, "dev", s, g, installed.prefix, extra));
var out: std.ArrayList(u8) = .empty;
out.appendSlice(a, environmentLines(c, s, installed, envStrict(c, g))) catch oom();
Expand Down Expand Up @@ -4818,6 +4867,8 @@ pub fn main(init: std.process.Init) u8 {
g.env_strict = true;
} else if (std.mem.eql(u8, x, "--json")) {
g.json_out = true;
} else if (std.mem.eql(u8, x, "--envrc")) {
g.envrc = true;
} else if (std.mem.eql(u8, x, "--buildenv")) {
g.buildenv = value(args, &i, "--buildenv");
} else if (joined(x, "--buildenv")) |v| {
Expand Down
54 changes: 54 additions & 0 deletions tests/test_dev_cli_modes.py
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,60 @@ def test_json_is_the_change_the_dev_lines_make(self):
self.assertIn("EB_LOCAL_DEV_PREFIX", values)
self.assertTrue(values["EB_LOCAL_DEV_PREFIX"].startswith(str(self.prefix) + "/dev/"), values)
self.assertNotIn("module load", got.stdout)
def test_envrc_writes_the_dev_line_and_updates_only_its_own_block(self):
envrc = self.root / ".envrc"
got = self.run_dev(["--envrc", "FFTW/3.3.10-GCC-15.2.0"])
self.assertEqual(got.returncode, 0, got.stderr)
self.assertEqual(got.stdout, "")
self.assertIn("direnv allow", got.stderr)
first = envrc.read_text()
lines = first.splitlines()
self.assertTrue(lines[0].startswith("# >>> eb-local dev >>>"), first)
self.assertEqual(lines[-1], "# <<< eb-local dev <<<")
self.assertEqual(len(lines), 3)
# the program is named by its own path, and the line replays this dev
self.assertTrue(lines[1].startswith('eval "$(' + binary.BIN + " "), lines[1])
self.assertTrue(lines[1].endswith(' dev FFTW/3.3.10-GCC-15.2.0)"'), lines[1])

# the user's own lines around the block survive a rewrite with other modules
envrc.write_text("export MINE=1\n" + first + "layout python\n")
again = self.run_dev(["--envrc", "--buildenv", "buildenv/custom", "HDF5/1.14.6-gompi-2026.1"])
self.assertEqual(again.returncode, 0, again.stderr)
second = envrc.read_text().splitlines()
self.assertEqual(second[0], "export MINE=1")
self.assertEqual(second[-1], "layout python")
self.assertEqual(len(second), 5)
self.assertIn("--buildenv buildenv/custom", second[2])
self.assertIn("HDF5/1.14.6-gompi-2026.1", second[2])
self.assertNotIn("FFTW", "\n".join(second))

# a file without the block gets it appended, after a newline
envrc.write_text("export MINE=1")
self.assertEqual(self.run_dev(["--envrc"]).returncode, 0)
third = envrc.read_text().splitlines()
self.assertEqual(third[0], "export MINE=1")
self.assertTrue(third[1].startswith("# >>> eb-local dev >>>"))
self.assertEqual(len(third), 4)

# a begin line without its end line is refused and the file is left alone
broken = "# >>> eb-local dev >>> by hand\nexport MINE=1\n"
envrc.write_text(broken)
refused = self.run_dev(["--envrc"])
self.assertNotEqual(refused.returncode, 0)
self.assertIn("without", refused.stderr)
self.assertEqual(envrc.read_text(), broken)

def test_the_envrc_block_is_valid_bash_that_runs_the_dev_lines(self):
self.assertEqual(self.run_dev(["--envrc"]).returncode, 0)
# bash, as direnv runs it: the block evaluates this program's dev lines
run = subprocess.run(
["bash", "-c", 'source ./.envrc >/dev/null 2>&1; printf %s "${EB_LOCAL_DEV_PREFIX-}"'],
cwd=self.root,
env={"PATH": "/usr/bin:/bin", "HOME": str(self.root), "EB_LOCAL_CONFIG": str(self.site),
"EB_LOCAL_PREFIX": str(self.prefix)},
capture_output=True, text=True,
)
self.assertTrue(run.stdout.startswith(str(self.prefix) + "/dev/"), run.stdout + run.stderr)

def test_names_the_host_ca_bundle_without_replacing_one_the_shell_set(self):
got = self.run_dev([])
Expand Down
Loading