kill, grep, sed, regex, cron, etc. vs. Linux commands
- Uname = Darwin (BSD)
- apt (Advanced Packaging Tool)
- System Preferences GUI
- System information
- You hot?
- CPU Utilization uptime
- Memory Statistics
- Top processes
- Command Line Tools
- USB info
- lsmod (modules) vs. Apple Kernel Extensions
- coreutils (Core Utilities)
- Cron Launchd Background Jobs
- Install appium_console gem
- Add wi-fi network
- Mac Message Reset
- More on macOS
This article compares and contrasts macOS utilites vs. Linux utilities – the Swiss Army Knife for almost every need.
Uname = Darwin (BSD)
The command that is common to all Linux/BSD variants is the one that returns the operating system name:
On macOS, the response is “Darwin”.
MacOS (Mac OS X) comes with the BSD (Berkeley Standard Distribution) version of command line tools which are slightly different from the Linux version (in Red Hat, Debian, Ubuntu, CoreOS, etc.) even though both are compliant with POSIX standards.
apt (Advanced Packaging Tool)
On Debian and its derivatives is the
apt-cache utility that goes with the
apt-get package manager (like Homebrew and MacPorts).
They are ported to Mac via https://github.com/KubaKaszycki/mac-apt
Use it to search within Python libraries:
apt-cache search python3 | wc -l
There is also http://rudix.org/ which is a collection of “the hassle-free way to get Unix programs on OS X”. Its packages include zshell and tig (Git spelled backwards), the Text-Mode Interface for Git.
System Preferences GUI
macOS provides a GUI to manage system configuration settings.
Mouse to the upper-left corner of the screen and click the Apple icon that appears to choose “System Preferences…”.
Alternately, you can also open the dialog with this command:
open /Applications/System\ Preferences.app
BTW, instead of typing out the whole line above, you can simply type “prefs” if you use a text editor to add this line in the ~/.bash_profile file:
alias prefs='open /Applications/System\ Preferences.app'
Apple stores its apps in folder “/Applications”. The “back-slash” character needs to precede every space character in the name because a space usually separates parts of commands.
BTW There is also a folder at “~/Applications” for user-level apps.
Open a Finder window to view files in both folders.
In folder “/Applications/Utilities” are several apps which include “System Information.app”.
macOS provides a GUI to display detailed information about system Hardware, Software, and Networks. Mouse to the upper-left corner of the screen and hold down Option while you click the Apple icon. “System Information…” appears. But you can also open it without the Option key by selecting “About This Mac” then pressing “System Report”.
Instead of examining various Linux config files (/etc/*elease, /proc/meminfo for memory, /proc/cpuinfo for number of cores), macOS has a “system_profiler” utility presenting many data types.
Get CPU thermal data on MacOS
PROTIP: Add this among your keyboard shortcuts in aliases.sh.
Internally, the display can be output as text using this command:
PROTIP: Use the command above to obtain your serial number for Apple Support.
“SPHardwareDataType” is one of several DataTypes or items of information listed by:
The list output:
SPParallelATADataType SPUniversalAccessDataType SPApplicationsDataType SPAudioDataType SPBluetoothDataType SPCameraDataType SPCardReaderDataType SPComponentDataType SPDeveloperToolsDataType SPDiagnosticsDataType SPDisabledSoftwareDataType SPDiscBurningDataType SPEthernetDataType SPExtensionsDataType SPFibreChannelDataType SPFireWireDataType SPFirewallDataType SPFontsDataType SPFrameworksDataType SPDisplaysDataType SPHardwareDataType SPHardwareRAIDDataType SPInstallHistoryDataType SPNetworkLocationDataType SPLogsDataType SPManagedClientDataType SPMemoryDataType SPNVMeDataType SPNetworkDataType SPPCIDataType SPParallelSCSIDataType SPPowerDataType SPPrefPaneDataType SPPrintersSoftwareDataType SPPrintersDataType SPConfigurationProfileDataType SPRawCameraDataType SPSASDataType SPSerialATADataType SPSPIDataType SPSmartCardsDataType SPSoftwareDataType SPStartupItemDataType SPStorageDataType SPSyncServicesDataType SPThunderboltDataType SPUSBDataType SPNetworkVolumeDataType SPWWANDataType SPAirPortDataType SPiBridgeDataType
There is a lot of information, so it takes time to generate output.
PROTIP: Save these files to provide to Support:
system_profiler -detailLevel basic > ~/Desktop/system_report.txt
Instead of “basic”, there is also “mini” and “full” scope of output. When providing full scope, output in .spx file extension so that it opens automatically using the GUI:
system_profiler -detailLevel full -xml > ~/Desktop/system_report_mini.spx
CPU Utilization uptime
Was your Mac rebooted recently?
The response also shows whether CPU utilization is increasing recently:
6:35 up 9 days, 11:56, 7 users, load averages: 2.09 2.24 2.06
“load averages” numbers are calculations of the average system load over three period of times: the last one-, five-, and fifteen-minute periods. These count the number of processes either using or waiting for CPU (the ready queue or run queue) increments the load number by 1. In a system with four CPUs, a load average of 3.73 would indicate that there were, on average, 3.73 processes ready to run, and each one could be scheduled into a CPU.
To obtain a new reading every 5 seconds, the command on macOS is:
The number of most interest is pageout, the “3459” in this sample response:
Mach Virtual Memory Statistics: (page size of 4096 bytes) free active inac wire faults copy zerofill reactive pageins pageout 49314 97619 154001 26746 42361341 320895 24148787 145786 50308 3459 49341 97814 153974 26551 2902 21 1429 0 0 0
On Linux systems, the “vmstat” command is similar but not identical.
To cancel the display, press control+C.
PROTIP: The memory page size is obtained using getconf PAGESIZE, which is “4096”.
Is your computer fan loud?
To list the top hungry processes consuming the CPU:
This refreshes automatically.
To cancel the display, press control+C keys (which works with any process you want to kill).
Alternately, install the htop utility using Homebrew:
brew install htop
The response includes:
/usr/local/Cellar/htop/2.2.0_1: 11 files, 188KB
So that we can kill it for fun, create a background process (by specifying &) which sleep for 999 seconds:
sleep 999 &
Get the process identifier:
List background processes:
+ Running sleep 999 &
The + shows the focus.
To list all processes with a niceness (NI) column:
Expand the terminal window width to avoid line wrapping.
UID PID PPID F CPU PRI NI SZ RSS WCHAN S ADDR TTY TIME CMD 501 2752 2749 4006 0 31 0 4320804 44 - Ss 0 ttys001 0:00.19 /Users/wilsonmar
### Niceness of priority
Default niceness of zero, but can be -20 to +19.
PROTIP: A niceness of +19 is a priority of 99, which is lowest.
nice -n 5 sleep 1000&
root permissions are needed to set nice below zero.
renice -n 5 sleep 1000&
To kill a single program by name:
To kill several progams by name:
Command Line Tools
To install additional utilities:
List what it installed to folder /Library/Developer/CommandLineTools (containing folders Library, SDKs, and usr):
- XCode version: https://developer.apple.com/legacy/library/documentation/Darwin/Reference/ManPages/man1/pkgutil.1.html
pkgutil –pkg-info=com.apple.pkg.CLTools_Executables grep version
Install the equivalent of Linux usbutils</stong>:
brew install mikhailai/misc/usbutils usbutils
Get the state of kernel objects that the kernel has matched to devices:
This has the same problem as Linux ioreg - it reflects the state of kernel objects that the kernel has matched to devices, not the devices themselves.*
Alternately, to work same problem as ioreg
ioreg -p IOUSB -l -w 0
lsmod (modules) vs. Apple Kernel Extensions
macOS has Kernel Extensions (kexts) to handle hardware*. Developers and software use the low-level kextload utility to load, kextunload to unload kexts, and kextstat to diagnose problems. There is also the kextutil command.
Although there are no direct equivalent in Linux, the Linux lsmod command lists operating system kernel modules defined in a folder containing “.ko” files:
ls /lib/modules/$(uname -r) -type -f -iname “*.ko”
Such udev rules are loaded in this sequence:
coreutils (Core Utilities)
Many who work with Linux distribution avoid minor (but annoying) differences by replacing OS X commands based on BSD with the GNU (Linux) version by installing the “coreutils” family of commands. It’s among Daniel Missler’s The First 10 Things I Do on a New Mac. This is about more than having the same toolset as on Linux machines. See The difference between Linux vs. Mac:
- Native capability to search for Unicode strings are not in the Mac (BSD) version of strings.
- ANSI-C escape sequences (e.g., \r, \t) beyond \n are not suppoed by the Mac sed command.
brew install coreutils
Then you can link:
ln -s /usr/local/bin/gtac /usr/local/bin/tac
NOTE: Add these lines to your .bashrc or .zshrc:
export PATH="$(brew --prefix coreutils)/libexec/gnubin:/usr/local/bin:$PATH"
brew --prefix coreutilsretrieves the path to the executable in the Homebrew package, which is, at time of writing:
PROTIP: Using a command to retrieve the path ensures that the version number from being hard-coded and thus possibly wrong.
Thus, the command is used in ~/.bash_profile to define variables for compilers to find:
export CFLAGS="-I$(brew --prefix readline)/include -I$(brew --prefix openssl)/include -I$(xcrun --show-sdk-path)/usr/include" export LDFLAGS="-L$(brew --prefix readline)/lib -L$(brew --prefix openssl)/lib"
Update Bash to version 4:
brew install bash brew link --overwrite bash
Switching to Zsh from Bash is a rather person choice. But it’s done thus:
brew install zsh # in /bin/zsh
Update Mac utilities
Several utilities come installed on macOS, but can be upgraded to the (newest?) version known by brew:
brew reinstall m4 brew reinstall make brew reinstall unzip
Because macOS already provides this software, when brew install runs, as its response message says, formulas for them are installed as keg-only, which means brew did not symlink it into /usr/local and installing another version in parallel can cause all kinds of trouble.”
So their installation would require placing their location in front of the default program’s location. That’s why many don’t bother.
Updates specific to text editors:
brew install nano # text editor brew install emacs brew install emacs --cocoa --srgb brew linkapps emacs brew install vim --override-system-vi brew install macvim --override-system-vim --custom-system-icons
Unfortunately, the Eclipse IDE was not capable of communicating with any interactive debugger other than gdb.
NOTE: Install Xcode (version 7.3.1 is known to work). The simplest way is to get is from the App Store. Once it is installed, lldb-mi will reside somewhere under the Xcode folder (it normally is /Applications/Xcode.app/Contents/Developer/usr/bin/lldb-mi). CDT will initialize the default LLDB path to this value if it is present. Note that if you had previous debug configurations with a non-default path for LLDB or if you changed the path in the preferences, the path to lldb will not be automatically set for you. You will have to edit the LLDB path manually in the debug configuration and/or you need to reset the preferences to defaults (if it was modified).
Restore GDB back on your Mac:
brew install gdb
The above does not create a ~/.gdbinit folder.
Notice in the response “On 10.12 (Sierra) or later with SIP, “brew info gdb” says you need to run:”
echo "set startup-with-shell off" >> ~/.gdbinit
- download the most recent GDB from https://www.sourceware.org/gdb/download/
- expand the gdb-7.12.1.tar.xz file: tar xopf gdb-7.12.1.tar.xz
- cd gdb-7.12.1 in terminal to open the gdb folder
- Follow the instructions in the README file in the gdb folder, or simply follow the following steps:
- ./configure, wait for the terminal
- make and wait again (which can take some time)
- sudo make install
- csrutil enable –without debug
This describes how to code-sign the GDB executable so that macOS will allow it to control other processes. It involves some manual steps.
codesign -s gdb-cert /usr/local/Cellar/gdb/7.12_1/bin/gdb
NOTE: To start dbg, use sudo or define alias gdb=”sudo gdb”
GNU Not pre-installed on macOS
Tutorials make use of some commands, so install them:
brew install gawk # in /usr/local/bin/gawk brew install gzip # in /usr/bin/gzip brew install wget # /usr/local/bin/wget brew install screen # in /usr/bin </pre>
brew install guile # GNU Ubiquitious Language for Extensions https://www.gnu.org/software/guile/ brew install gpatch brew install binutils # https://en.wikipedia.org/wiki/GNU_Binutils
Below are GNU packages on https://www.gnu.org/software but not on macOS:
brew install grep --with-default-names brew install gnu-indent --with-default-names # C code prettifier brew install gnu-sed --with-default-names brew install gnu-tar --with-default-names brew install gnu-which --with-default-names brew install gnutls brew install ed --with-default-names # in /bin/ed brew install watch brew install wdiff --with-gettextThese are searchbrew install diffutils brew install wdiff --with-gettext
–with-default-names prevents Homebrew from prepending a “g” to each command, so they can be used instead of the ones shipped by OS X.
Missing from the list above is brew install findutils –with-default-names becuase that causes ‘brew doctor’ to issue warning: “Putting non-prefixed findutils in your path can cause python builds to fail.”
brew install gnupg # gpg brew install gnupg2 # gpg2
### Add to MacOS Non-GNU commands
brew install file-formula brew install less brew install openssh brew install perl518 # must run "brew tap homebrew/versions" first! brew install rsync # to backup
These are handled by specific request:
brew install git brew install python brew install svn # in /usr/bin/svn
### Utilities for Mac only
brew install htop # like GNU top brew install nmap brew install tmux
### MoreUtils and parallel
brew install moreutils --without-parallel
The Debian description for it is “Unix tools that nobody thought to write long ago, when Unix was young.”
Read about each utility command at https://rentes.github.io/unix/utilities/2015/07/27/moreutils-package/
- chronic runs a command quietly unless it fails
- combine combines lines in two files using boolean operations
- errno look up errno names and descriptions
- ifdata get network interface info without parsing ifconfig output
- ifne run a program if the standard input is not empty
- isutf8 check if a file or standard input is utf-8
- lckdo execute a program with a lock held
- mispipe pipe two commands, returning the exit status of the first
- parallel run multiple jobs at once (conflicts with brew install parallel, so don’t install that stand-alone)
- pee tee standard input to pipes
- sponge soak up standard input and write to a file. See this
- ts timestamp standard input
- vidir edit a directory in your text editor
- vipe insert a text editor into a pipe
- zrun automatically uncompress arguments to command
Its home page at https://joeyh.name/code/moreutils/ says more are on the way.
Riff on it at https://news.ycombinator.com/item?id=9013570
To generate a random set of 32 upper and lower case characters (with special characters) for use as a password:
openssl rand -base64 32
Cron Launchd Background Jobs
This mentions that Apple has deprecated cron in favor of launchd (a daemon running under the System context). to automatically start (after reboots) service programs at boot time.
If the system is turned off or asleep, cron jobs do not execute until the next designated time occurs.
However, a launchd job will run when the computer wakes up if the computer was asleep when the job should have run (if the StartCalendarInterval key has been set).
Since it’s a background process, launchd doesn’t present a user interface. So you get “launchd cannot be run directly.” when you run launchd like other commands.
The standard way now to run a service on Mac OS X is to use launchd , a program that starts, stops and manages daemons and scripts in Apple OS X environments.
An XML document named with file extension .plist defines its properties.
The sample file below defines the Nexus Repository Manager from Sonatype.com installed in
The above is the
com.sonatype.nexus.plist file in
Change its ownership and access rights:
sudo chown root:wheel /Library/LaunchDaemons/com.sonatype.nexus.plist sudo chmod 644 /Library/LaunchDaemons/com.sonatype.nexus.plist
PROTIP: Consider setting up a different user to run the repository manager and adapt permissions and the RUN_AS_USER setting in the nexus startup script.
To manually start it after the configuration:
sudo launchctl load /Library/LaunchDaemons/com.sonatype.nexus.plist
Install appium_console gem
gem uninstall -aIx appium_lib gem uninstall -aIx appium_console gem install --no-rdoc --no-ri appium_console
Install flaky gem:
gem uninstall -aIx flaky gem install --no-rdoc --no-ri flaky
Add wi-fi network
NOTE To avoid the manual effort to add a wi-fi, use this command:
/usr/sbin/networksetup -addpreferredwirelessnetworkatindex Airport my_ssid 0 my_security my_passkey
- my_ssid is the SSID of your network.
- my_security is the level of encryption (WEP, WPA, WPA2, etc)
- my_passkey is your encryption passkey for your wireless network.
networksetup -setairportnetwork [interface] [router SSID] [password]
nix-shell environment on top of nixos/nixpkgs
Mac Message Reset
http://clarkgrubb.com/diagnostic-tools compares Linux, Darwin, and Windows utilities
https://support.apple.com/kb/DL75?viewlocale=en_US&locale=en_US Apple’s Common Criteria Tools for 10.5
More on macOS
This is one of a series on macOS (Mac OSX):
- MacOS Hardware and accessories
- MacOS Boot-up
- MacOS Terminal Tips and Tricks
- MacOS Keyboard tricks
- Text editors and IDEs on MacOS
- MacOS Setup automation
- MacOS Homebrew installers
- Manage Disk Space on MacOS
- Data Backups on MacOS
- Ports open
- Applications on MacOS
- Windows on Apple MacOS
- Packer create Vagrant Windows image
- Python on MacOS
- Maven on MacOS
- Ruby on MacOS
- Java on MacOS
- Node on MacOS installation
- PHP on MacOS
- Scala ecosystem