Jump to: Documentation Videos Downloads Misc

G'Day, I'm Brendan. I use this page to share links and downloads from my hobbies and work with computers. This work has included system administration, Unix security, Solaris, Linux, programming and kernel engineering. These days I work on performance and live in San Francisco.

I have two blogs: personal and work. I'm also on twitter and linkedin.

Documentation

Various things I've written, roughly from most to least recent, include:




• The DTrace book with Jim Mauro, Prentice Hall 2011 (ISBN 0132091518). A sample chapter on File Systems is online. This 1152 page book took over a year to write, including the research, development and testing of dozens of new DTrace scripts and one-liners, and soliciting input from many experts.
• A long post about Using SystemTap on the Ubuntu and CentOS Linux distributions.
• An article to introduce the technique of Off-CPU Performance Analysis, a simple principle that can identify the cause of high latency due to blocking events, including I/O and lock contention.
• Top 10 DTrace Scripts for Mac OS X performance analysis and troubleshooting, written to reach the broader Mac OS X community. This includes step by step instructions on how to find and run the Terminal application and sudo.
• A series of blog posts on File System latency, using MySQL as an example application (1, 2, 3, 4, 5).
• MySQL Query Latency using DTrace.
• A series of blog posts on the DTrace pid provider, going beyond what was covered in the DTrace book.
• The Visualizations for Performance Analysis slide deck, for USENIX/LISA 2010 (video also available). This illustrates visuals for performance analysis, showing what is effective and becomming important for cloud computing environments.
• An article for ACMQ, also published by CACM, on Visualizing System latency. This includes interesting latency heat maps I had found, including the Rainbow Pterodactyl and the Icy Lake.
• A series of posts on performance testing the 7000 series of storage appliances (1, 2, 3). These were written at a time when I was often pulled in to save benchmarking mishaps, and needed to share tips to avoid common mistakes. They were very successful (and thanks to those who read them) as the calls for help were greatly reduced.
• The original ZFS L2ARC post and later L2ARC Screenshots. Since OpenSolaris made all code changes public each night, my block comment in usr/src/uts/common/fs/zfs/arc.c disguised the then-secret intent of this techology by listing "short-stroked disks" as the first intended device, instead of SSDs.
• The companion to Solaris Internals 2nd Edition: Solaris Performance and Tools, with Richard McDougall and Jim Mauro, Prentice Hall 2006 (ISBN 0131568191).
• My Solaris 10 Zones page: the first showing how to configure Solaris Zones with Resource Controls (which I had figured out the hard way).
• A page on DTrace, where I described and shared early scripts I was developing, and the DTraceToolkit.
• Older and out of date Unix or Sun Solaris material is in the Sun Crypt for historic interest.

Videos

Shouting in the Datacenter was a video that Bryan and I made on the spur of the moment on New Year's Eve 2008, which went viral (750,000+ views). I've had many emails from companies about it: it seems to be spawning an industry of sound proofing data centers. There is also a making of... video to answer the next question: how did I discover it?
Some of my videos since then, in reverse chronological order:

• Short talks on performance tools for Solaris-based operating systems: vmstat, mpstat, and load averages (2011).
• An extended version of my Percona Live New York 2011 talk on Breaking Down MySQL/Percona Query Latency With DTrace was filmed (90 mins).
• A video of my LISA 2010 Visualizations for Performance talk is available on the usenix.org site (80 mins).
• I've given many technical talks of things going right. This talk was about things going wrong: Little Shop of Performance Horrors at FROSUG in Colorado, 2009 (2.5 hours).

Downloads

These are some personal software projects I've developed. (I've also written software as a professional kernel engineer, which isn't listed below, including the ZFS L2ARC.) These are all open source with no warranty - use at your own risk. Some of these are computer security tools, which may be illegal to own and/or run in your own country if they are misidentified as cracking/hacking tools. If you are unsure, please don't download them.

These Perl programs should run anywhere that has Perl, and are usually tested on Solaris, Red Hat Linux and Windows.

• Chaosreader Trace TCP/UDP sessions and fetch application data from snoop or tcpdump logs. This will fetch telnet sessions, FTP files, HTTP transfers, SMTP emails, ... example output was created by Chaosreader to link to the extracted HTTP sections, telnet sessions, and FTP files found in a snoop log. This can also create telnet replay programs that play back sessions in realtime: example. A tool for forensics or network troubleshooting. download code.
• K9Toolkit A collection of Perl programs for Solaris that use the Sun::Solaris::KStat library. This includes tools to print load averages for CPU, memory, disks and network, to aid finding performance bottlenecks.
• Distillerror Summarizes truss(1) or strace(1) output to highlight errors. See the Solaris example, the Red Hat example, or a larger example.
• Net::SnoopLog is a Perl library to read snoop network packet logs (RFC1761), and Net::TcpDumpLog reads tcpdump/libpcap logs.
• Algorithm::Hamming::Perl is a Perl library to implement the Hamming ECC algorithm, for single bit auto error correction.
• FreqCount is a simple frequency counter. Useful for processing logs (most common IP addr, port, etc..). example.
• PortPing is a version of ping that connects using ssh (or other ports), not ICMP. Good for checking firewalls. example.
• MTUfinder tests different sized HTTP requests to a web server, highlighting MTU size problems. example.
• FindBill finds backup super blocks on a Solaris UFS for "fsck -o b=..." (if "newfs -N" dosen't help). example.
• Sun Crypt has some of my older software, including the performance analysis tools: Psio for disk I/O by-process, and CacheKit for hardware (I$, D$, E$) and software (DNLC, inode, segmap, segvn) cache analysis.
• Specials is a collection of "special" programs for system administrators. Mostly Perl.

These shell scripts run on most versions of Unix or Linux. Usually developed on Solaris and Red Hat Linux.

• DtkshDemos This is a collection of X11 dtksh scripts. They include xvmstat - a GUI version of vmstat; and xplot - a generic data plotter. Written for any Unix with dtksh.
• BBaseline is a small script to create a baseline of the system's performance, by logging the output of several tools. By creating logs during normal and peak activity, this can assist performance tuning. Easy to customize the baseline content, and to grep the baselines. See the example output.
• Blacklight is an IDS tool to check if files have been modified - changed permissions, size, modification timestamp and checksum. It creates a single text database file. example.
• total is a simple awk script to sum a field (example), and field prints a field (example). These exist for convenience at the shell.

This code should run wherever C code can be compiled properly. Developed on Solaris and Red Hat Linux with gcc.

• Nicstat prints network interface stats inculding Kbytes/sec for Solaris (uses Kstat). Example here. There is also a Perl version.
• listprusage prints process resource usage statistics such as minor faults and syscalls by PID. Solaris (uses procfs). Example here.
• Fastburden This is a performance testing tool that can generate a test flood of client web traffic towards a web server, or a web proxy server. This can replay traffic from existing Apache or Squid access logs at high speed. example.
• Fastbrute This is a vunerability testing tool that can generate a "mock" FTP brute force attack. example.

• DTrace Tools such as iosnoop, opensnoop, bitesize.d, execsnoop, shellsnoop, tcpsnoop, ...
• DTraceToolkit a collection of over 200 scripts, with man pages and example files.
• DTraceTazTool a GUI to plot live disk activity.

• Quick Text Toaster v1.0 An editor I wrote many years ago to grab text from corrupted files. Works with executables, documents, etc.

• QBASIC CRO v1.2 I still find this old program amusing. It is a digital (on/off) CRO that samples the parallel port at 1KHz. screenshot.

Guessing Game is written in awk C C++ csh Fortran java ksh Pascal Perl QBASIC sh and more as a language comparison. You guess a number between 1 and 100 and your score is saved to high score list. See the example output.

Misc

• Recommended Reading: A list of my favourite books. Unix, Performance, Security...
• External Sites: Other interesting places on the web.
• Photos: Some photos I've taken.
• Games: My favourite computer games.
• The dvorak keymap file for Solaris Sun or x86 keyboards (see why).