awk

<BODY > <HR><center> <table border=1> <td> <A NAME="tex2html51" HREF="node4.html"><img height=36 width=36 alt="PREVIOUS" src="../../../icons/latex2html/previous.gif"></A></td> <td> <A NAME="tex2html57" HREF="unix_utilities.html"><img height=36 width=36 alt="UP" src="../../../icons/latex2html/up.gif"></A></td> <td> <A NAME="tex2html59" HREF="node6.html"><img height=36 width=36 alt="NEXT" src="../../../icons/latex2html/next.gif"></A></td> <td><a href="contents-node5.html"><img height=36 width=36 alt="CONTENTS" src="../../../icons/latex2html/toc.gif"></a></td> </table> </center> <HR>  <H1><A NAME="SECTION00050000000000000000"> awk</A> </H1> The <B>awk</B> utility is used to make selections and substitutions in text files. It is actually a highly sophisticated C-like interpretive programming language. Our use of <B>awk</B> will be very limited, and will come with complete instructions with each case. We give a couple of common, useful examples here. For more information about <B>awk</B>, see A. Aho, B.W. Kernighan, and P.J. Weinberger, <EM>The AWK Programming Language</EM> (Addison-Wesley, Reading, MA, 1988). <P> Here is an example of where you might use <B>awk</B>. Suppose you have a program that produces a list of <IMG WIDTH="34" HEIGHT="33" ALIGN="MIDDLE" BORDER="0" SRC="img1.gif" ALT="$x,y$"> values like this: <PRE> 2.5 0.513 2.7 0.416 2.9 0.213 </PRE> in a file called <B>oldfile</B>. Suppose you decided that you wanted to multiply the <IMG WIDTH="15" HEIGHT="33" ALIGN="MIDDLE" BORDER="0" SRC="img2.gif" ALT="$y$"> value by 2 on every line and put the result in a file called <B>newfile</B>. The <B>awk</B> command to do this is <PRE> awk '{print $1, 2*$2;}' oldfile > newfile </PRE> Inside the single quotes <B>''</B> is the instruction to <B>awk</B>. The instruction is applied to each line, one at a time. <B>Awk</B> sees each line as a bunch of fields separated by ``white'' space (blanks and tabs are white space). Each line in this case has two fields, therefore. The single instruction says for each line, print the first field and twice the second field. <P> <B>Awk</B> can print the third field on all lines containing the string <B>ans</B> with the command <PRE> awk '/ans/{print $3;}' oldfile </PRE> This procedure is very handy for extracting numbers from complicated output files for subsequent processing, as long as you had the foresight to include a unique keyword <B>ans</B> on the line containing the number you wanted to extract. Since we chose not to redirect output in this example, it comes to the screen. (You could redirect it to a file, of course.) <P> <B>Awk</B> can average all the numbers in a field. Suppose in the above list of numbers, you wanted to compute the average value of the second field. The <B>awk</B> command is <PRE> awk 'BEGIN{s=0;}{s=s+$2;}END{print s/NR;}' oldfile </PRE> There are actually three instructions given to <B>awk</B>, separated by a semicolon <B>;</B>. The first <B>BEGIN{s=0}</B> is executed only once before the file is read. It initializes the variable <B>s</B> that is to hold the sum. This step is actually not necessary, since all variables are automatically initialized to zero. The second command <IMG WIDTH="89" HEIGHT="37" ALIGN="MIDDLE" BORDER="0" SRC="img3.gif" ALT="$s = s + \$2$"> is executed for each line and accumulates the sum. The third command <B>END{print s/NR;}</B> is executed only after the last line has been processed. It says to print the sum, divided by <B>NR</B>, a special <B>awk</B> variable that gives the number of lines (``records'') read so far. <P> In these examples the awk scripts are short enough to put on the command line, enclosed between single quotes. Longer scripts are generally put in files. Scripts are easier to read if the commands are separated by line breaks, just as you would a C program. If the file name extension is <B>.awk</B> as in <B>avg.awk</B>, The emacs editor recognizes the name and enters a useful awk editing mode similar to its C and C++ modes. If we had done that with the averaging script above, we would run it using <PRE> awk -f avg.awk oldfile </PRE> <P> One can use awk to do quick calculator-style arithmetic. To evaluate <IMG WIDTH="69" HEIGHT="37" ALIGN="MIDDLE" BORDER="0" SRC="img4.gif" ALT="$cos(3.5)$">, for example, do <PRE> awk 'BEGIN{print cos(3.5);}' </PRE> The syntax for arithmetic expressions is the same as in C. In this case awk is not working on any file, so our commands must be executed under <B>BEGIN</B>. <P> Sometimes we like to be able to change an awk variable each time we run a script. Instead of editing the script each time, we specify the variable on the command line. Here is an awk script for selecting all lines for which the first field matches a specified key string <PRE> # keyselect.awk { if($1==KEYSTRING)print; } </PRE> We run it with <PRE> awk -f keyselect.awk -v KEYSTRING=ans </PRE> In this case the value of the variable <B>KEYSTRING</B> is set to ``ans'' on the command line. <P> One can do much more with <B>awk</B>. Indeed one could almost use <B>awk</B> as a programming language in place of C++, Fortran or C, but its strengths lie in record manipulation, and not in number crunching, and some of the most elegant applications involve only one-liners as in the foregoing examples. <P> <P> <HR><center> <table border=1> <td> <A NAME="tex2html51" HREF="node4.html"><img height=36 width=36 alt="PREVIOUS" src="../../../icons/latex2html/previous.gif"></A></td> <td> <A NAME="tex2html57" HREF="unix_utilities.html"><img height=36 width=36 alt="UP" src="../../../icons/latex2html/up.gif"></A></td> <td> <A NAME="tex2html59" HREF="node6.html"><img height=36 width=36 alt="NEXT" src="../../../icons/latex2html/next.gif"></A></td> <td><a href="contents-node5.html"><img height=36 width=36 alt="CONTENTS" src="../../../icons/latex2html/toc.gif"></a></td> </table> </center> <HR>  <HR><P><ADDRESS> <I></I> </ADDRESS> </BODY>