301

I need to retrieve last 100 lines of logs from the log file. I tried the sed command

sed -n -e '100,$p' logfilename

Please let me know how can I change this command to specifically retrieve the last 100 lines.

mdsadiq
  • 788
  • 1
  • 9
  • 11
Surabhi
  • 3,508
  • 2
  • 17
  • 12

7 Answers7

555

You can use tail command as follows:

tail -100 <log file>   > newLogfile

Now last 100 lines will be present in newLogfile

EDIT:

More recent versions of tail as mentioned by twalberg use command:

tail -n 100 <log file>   > newLogfile
Steephen
  • 14,645
  • 7
  • 40
  • 47
50

"tail" is command to display the last part of a file, using proper available switches helps us to get more specific output. the most used switch for me is -n and -f

SYNOPSIS

tail [-F | -f | -r] [-q] [-b number | -c number | -n number] [file ...]

Here

-n number : The location is number lines.

-f : The -f option causes tail to not stop when end of file is reached, but rather to wait for additional data to be appended to the input. The -f option is ignored if the standard input is a pipe, but not if it is a FIFO.

Retrieve last 100 lines logs

To get last static 100 lines  
     tail -n 100 <file path>

To get real time last 100 lines
     tail -f -n 100 <file path>
Amitesh Bharti
  • 14,264
  • 6
  • 62
  • 62
28

You can simply use the following command:-

tail -NUMBER_OF_LINES FILE_NAME

e.g tail -100 test.log

  • will fetch the last 100 lines from test.log

In case, if you want the output of the above in a separate file then you can pipes as follows:-

tail -NUMBER_OF_LINES FILE_NAME > OUTPUT_FILE_NAME

e.g tail -100 test.log > output.log

  • will fetch the last 100 lines from test.log and store them into a new file output.log)
Arun Kumar N
  • 1,611
  • 1
  • 20
  • 25
22

Look, the sed script that prints the 100 last lines you can find in the documentation for sed (https://www.gnu.org/software/sed/manual/sed.html#tail):

$ cat sed.cmd
1! {; H; g; }
1,100 !s/[^\n]*\n//
$p

$ sed -nf sed.cmd logfilename

For me it is way more difficult than your script so

tail -n 100 logfilename

is much much simpler. And it is quite efficient, it will not read all file if it is not necessary. See my answer with strace report for tail ./huge-file: https://unix.stackexchange.com/questions/102905/does-tail-read-the-whole-file/102910#102910

Community
  • 1
  • 1
9

I know this is very old, but, for whoever it may helps.

less +F my_log_file.log

that's just basic, with less you can do lot more powerful things. once you start seeing logs you can do search, go to line number, search for pattern, much more plus it is faster for large files.

its like vim for logs[totally my opinion]

original less's documentation : https://linux.die.net/man/1/less

less cheatsheet : https://gist.github.com/glnds/8862214

mdsadiq
  • 788
  • 1
  • 9
  • 11
  • One important characteristic of "less" is that it does not load the entire file into memory, therefore opening large files with it is indicated. – Fergara Dec 18 '20 at 14:28
3
len=`cat filename | wc -l`
len=$(( $len + 1 ))
l=$(( $len - 99 ))
sed -n "${l},${len}p" filename

first line takes the length (Total lines) of file then +1 in the total lines after that we have to fatch 100 records so, -99 from total length then just put the variables in the sed command to fetch the last 100 lines from file

I hope this will help you.

axy
  • 141
  • 9
0

If you only plan to print out the last n lines of a file, using the tail command can be easier!

  • The tail -n <FILE> command prints the last n lines of each FILE to standard output. If -n is not provided, n will be considered 10 by default.

    • tail debug.log --> printing the last 10 lines
    • tail -n 100 debug.log --> printing the last 100 lines

If you are looking for certain characters in your logs, you can use grep as follows

  • tail -n 100 debug.log | grep ERROR --> printing the last 100 lines with the word ERROR in them (you'll see an output only if you have the word ERROR in the last 100 lines of your file)

FYI: command head -n <FILE> prints the first n lines of each FILE to standard output.

Hossein Kalbasi
  • 1,641
  • 2
  • 13
  • 26