Is it really possible to process billion rows with Linux shuf command, in seconds?

There was a buzz on the net when some one posted in Stackoverflow claiming he was able to process billion rows using shuf command in Linux platform. The following video has been created to test the reality of this claim.

 

What is “shuf” command?

The shuf command generates random permutations from input lines to standard output. If given a file or series of files it will shuffle the lines and write the result to standard output.

Linux Command Challenge – shuf with billion rows

 

 

Leave a Reply

Your email address will not be published. Required fields are marked *


*

Please wrap all source codes with [code][/code] tags.

This site uses Akismet to reduce spam. Learn how your comment data is processed.