- angle-grinder - slice and dice log files on the command line.
- lnav - log file navigator with search and automatic refresh.
- GoAccess - real-time web log analyzer and interactive viewer that runs in a terminal.
- ngxtop - real-time metrics for nginx server.
-
diff --git a/docs/sysadmin-devops/system-monitoring-tracing/Log Analyzers.md b/docs/sysadmin-devops/system-monitoring-tracing/Log Analyzers.md new file mode 100644 index 0000000..9d425de --- /dev/null +++ b/docs/sysadmin-devops/system-monitoring-tracing/Log Analyzers.md @@ -0,0 +1,11 @@ +- **[angle-grinder](https://github.com/rcoh/angle-grinder)** — Slice and dice log files on the command line (aggregation, percentiles, live updates). + *Tags: log-analysis, CLI, aggregation, real-time, Rust* + +- **[lnav](https://lnav.org/)** — Advanced log file navigator with search, auto-refresh, format detection, merging, filtering, and SQLite querying in a TUI. + *Tags: log-analysis, CLI, TUI, viewer, search, SQLite* + +- **[GoAccess](https://goaccess.io/)** — Real-time web log analyzer and interactive terminal viewer (HTTP stats, visitors, requests, bandwidth). + *Tags: log-analysis, CLI, real-time, web-logs, HTTP, analytics, viewer* + +- **[ngxtop](https://github.com/lebinh/ngxtop)** — Real-time top-like metrics from nginx access logs (requests, status, upstreams). + *Tags: log-analysis, CLI, real-time, nginx, web-logs, monitoring, top-like* \ No newline at end of file diff --git a/docs/tools - (migrate out)/cli-tools.md b/docs/tools - (migrate out)/cli-tools.md index b95aeed..e6fc341 100644 --- a/docs/tools - (migrate out)/cli-tools.md +++ b/docs/tools - (migrate out)/cli-tools.md @@ -1,66 +1,66 @@ -# CLI Tools -Curated, high-quality command-line utilities across sysadmin, security, networking, productivity, and development workflows. - -## Shells & Prompting -Interactive shells, enhancers, prompts, plugins, fuzzy finders/jump tools - -[**GNU Bash**](https://www.gnu.org/software/bash/) - is an sh-compatible shell that incorporates useful features from the Korn shell and C shell. -[**Zsh**](https://www.zsh.org/) - is a shell designed for interactive use, although it is also a powerful scripting language. -[**tclsh**](https://tcl-lang.org/) - is a very powerful cross-platform shell, suitable for a huge range of uses. -[**bash-it**](https://github.com/Bash-it/bash-it) - is a framework for using, developing and maintaining shell scripts and custom commands. -[**Oh My ZSH!**](https://ohmyz.sh/) - is the best framework for managing your Zsh configuration. -[**Oh My Fish**](https://github.com/oh-my-fish/oh-my-fish) - the Fishshell framework. -[**Starship**](https://github.com/starship/starship) - the cross-shell prompt written in Rust. -[**powerlevel10k**](https://github.com/romkatv/powerlevel10k) - is a fast reimplementation of Powerlevel9k ZSH theme. - -### Shell Plug-ins - -[**z**](https://github.com/rupa/z) - tracks the folder you use the most and allow you to jump, without having to type the whole path. -[**fzf**](https://github.com/junegunn/fzf) - is a general-purpose command-line fuzzy finder. -[**zsh-autosuggestions**](https://github.com/zsh-users/zsh-autosuggestions) - Fish-like autosuggestions for Zsh. -[**zsh-syntax-highlighting**](https://github.com/zsh-users/zsh-syntax-highlighting) - Fish shell like syntax highlighting for Zsh. -[**Awesome ZSH Plugins**](https://github.com/unixorn/awesome-zsh-plugins) - A list of frameworks, plugins, themes and tutorials for ZSH. - -## Terminal & Multiplexing -- Multiplexers (tmux/screen), terminal emulators/utils, session managers - -## Text & File Manipulation -- Editors (vim/neovim/micro), viewers (bat, hexyl), finders (fd, ripgrep), fuzzy (fzf), diff/pretty (delta), file ops (exa/lsd, dust, duf, ncdu) - -## Filesystem & Disk -- Disk usage/analyzers, mount/umount helpers, secure delete/wipe, inotify tools - -## System Monitoring & Diagnostics -- Process (htop/btop, glances, bottom), memory/CPU (nvtop if GPU), logs (lnav, goaccess), debuggers (strace, ltrace), perf tools - -## Networking & Recon -### Core Utilities -- curl, wget, httpie, aria2, transmission-cli - -### Scanning & Discovery -- nmap, masscan, RustScan, naabu, zmap - -### Traffic Capture & Analysis -- tcpdump, tshark, termshark, wireshark-cli equivalents - -### DNS & Subdomain -- subfinder, amass, dnsx, dnstwist, fierce - -### Proxy / Tunneling / TOR -- proxychains, redsocks, tor, torsocks, chisel, bore - -## Security & Crypto -- openssl, gnupg/gpg, age/sops, hashcat/john (if CLI-focused), secure-delete tools, password managers (pass, bitwarden-cli) - -## Databases & Data -- sqlite3 utils, jq/yq (JSON/YAML), miller (CSV/TSV), csvkit, duckdb CLI - -## Development & Versioning -- git cli helpers/extras (gh, git-extras, lazygit), diff-so-fancy/delta, tig - -## Productivity & Misc -- Task runners (task, just), note-taking (jrnl, taskwarrior), calendars (calcurse), chat/IRC (weechat, irssi), RSS (newsboat) - -## Benchmarking & Performance -- wrk, hyperfine, fio, sysbench - +# CLI Tools +Curated, high-quality command-line utilities across sysadmin, security, networking, productivity, and development workflows. + +## Shells & Prompting +Interactive shells, enhancers, prompts, plugins, fuzzy finders/jump tools + +[**GNU Bash**](https://www.gnu.org/software/bash/) - is an sh-compatible shell that incorporates useful features from the Korn shell and C shell. +[**Zsh**](https://www.zsh.org/) - is a shell designed for interactive use, although it is also a powerful scripting language. +[**tclsh**](https://tcl-lang.org/) - is a very powerful cross-platform shell, suitable for a huge range of uses. +[**bash-it**](https://github.com/Bash-it/bash-it) - is a framework for using, developing and maintaining shell scripts and custom commands. +[**Oh My ZSH!**](https://ohmyz.sh/) - is the best framework for managing your Zsh configuration. +[**Oh My Fish**](https://github.com/oh-my-fish/oh-my-fish) - the Fishshell framework. +[**Starship**](https://github.com/starship/starship) - the cross-shell prompt written in Rust. +[**powerlevel10k**](https://github.com/romkatv/powerlevel10k) - is a fast reimplementation of Powerlevel9k ZSH theme. + +### Shell Plug-ins + +[**z**](https://github.com/rupa/z) - tracks the folder you use the most and allow you to jump, without having to type the whole path. +[**fzf**](https://github.com/junegunn/fzf) - is a general-purpose command-line fuzzy finder. +[**zsh-autosuggestions**](https://github.com/zsh-users/zsh-autosuggestions) - Fish-like autosuggestions for Zsh. +[**zsh-syntax-highlighting**](https://github.com/zsh-users/zsh-syntax-highlighting) - Fish shell like syntax highlighting for Zsh. +[**Awesome ZSH Plugins**](https://github.com/unixorn/awesome-zsh-plugins) - A list of frameworks, plugins, themes and tutorials for ZSH. + +## Terminal & Multiplexing +- Multiplexers (tmux/screen), terminal emulators/utils, session managers + +## Text & File Manipulation +- Editors (vim/neovim/micro), viewers (bat, hexyl), finders (fd, ripgrep), fuzzy (fzf), diff/pretty (delta), file ops (exa/lsd, dust, duf, ncdu) + +## Filesystem & Disk +- Disk usage/analyzers, mount/umount helpers, secure delete/wipe, inotify tools + +## System Monitoring & Diagnostics +- Process (htop/btop, glances, bottom), memory/CPU (nvtop if GPU), logs (lnav, goaccess), debuggers (strace, ltrace), perf tools + +## Networking & Recon +### Core Utilities +- curl, wget, httpie, aria2, transmission-cli + +### Scanning & Discovery +- nmap, masscan, RustScan, naabu, zmap + +### Traffic Capture & Analysis +- tcpdump, tshark, termshark, wireshark-cli equivalents + +### DNS & Subdomain +- subfinder, amass, dnsx, dnstwist, fierce + +### Proxy / Tunneling / TOR +- proxychains, redsocks, tor, torsocks, chisel, bore + +## Security & Crypto +- openssl, gnupg/gpg, age/sops, hashcat/john (if CLI-focused), secure-delete tools, password managers (pass, bitwarden-cli) + +## Databases & Data +- sqlite3 utils, jq/yq (JSON/YAML), miller (CSV/TSV), csvkit, duckdb CLI + +## Development & Versioning +- git cli helpers/extras (gh, git-extras, lazygit), diff-so-fancy/delta, tig + +## Productivity & Misc +- Task runners (task, just), note-taking (jrnl, taskwarrior), calendars (calcurse), chat/IRC (weechat, irssi), RSS (newsboat) + +## Benchmarking & Performance +- wrk, hyperfine, fio, sysbench +