Remove new lines
--- www.fir3net.com ---
‹ First < 200 201 202 203 204 > Last ›
se(){ while read a;do [ "$a" != "${a#*$@*}" ]&&echo $a;done ;} # usage: se pattern # use in place of sed /pat/!d where RE are overkill
Functions: read sed
sed /pat/!d without using sed (no RE; limited to shell patterns aka globbing)
POSIX requires this "string truncating" functionality.
might as well use it, at least for very small tasks where invoking sed and using RE is overkill.
git branch | cut -c3- | grep -v "^master$" | while read line; do git branch -d $line; done | grep 'Deleted branch' | awk '{print $3;}' | while read line; do git push :$line; done
Functions: awk cut grep read
delete local *and* remote git repos if merged into local master
attempts to delete all local branches. git will fail on any branches not fully merged into local master, so don't worry about losing work. git will return the names of any successfully deleted branches. Find those in the output with grep, then push null repositories to the corresponding names to your target remote.
assumes:
- your local and remote branches are identically named, and there's nothing extra in the remote branch that you still want
- EDIT: you want to keep your local master branch
svn log | perl -pe 's/\n//g => s/^-.*/\n/g'
dirrrty: use -p to chomp automatically, substitute all newlines away and then replace the "---" by a newline ? bingo!
s/// => s/// is just a cooler way to write s///, s/// which is just the small brother of s///; s/// (comma is an operator!)
have fun!
agrep -2 differentially README.txt
Approximate grep for finding typos
To install in Ububtu: "sudo apt-get install agrep"
echo '
Prettify XML in pipeline
xmllint2 comes with GNU libxml2 library.
(based on: http://vim.wikia.com/wiki/Format_your_xml_document_using_xmllint)
recode UTF8..UTF-16LE linux-utf8-file.txt
Convert file from UTF8 (no BOM) to UTF16 (with BOM)
Convert file from the UTF8 encoding used on Linux (has no "EF BB BF" byte order mark at the start) to the UTF-16 encoding used on Windows (has an "FF FE" byte order mark at the start).
Thanks to commenter: previous iconv command was the obsolete way to do it.
for ((i=1; i<67; i++)) do wget http://www.phrack.org/archives/tgz/phrack${i}.tar.gz -q; done
This will download all the phracks! Enjoy!
ack --pager='less -r'
find /protocollo/paflow -type f -mtime +5 | xargs tar -cvf /var/dump-protocollo/`date '+%d%m%Y'_archive.tar`
How to archive all the files that are not modified in the last x number of days?
The following command finds all the files not modified in the last 5 days under /protocollo/paflow directory and creates an archive files under /var/dump-protocollo in the format of ddmmyyyy_archive.tar
TZ="$tz_dest" date -d "$(TZ="$tz_orig" date -d "$tm")"
Timezone conversions (eg: what time was @tz_dest when it was $tm @tz_orig)
let NOW=`date +%s`/86400 ; PASS_LAST_CHANGE=`grep $USER /etc/shadow | cut -d: -f3` ; PASS_LIFE=`grep $USER /etc/shadow | cut -d: -f5`; DAYS_LEFT=$(( PASS_LAST_CHANGE + PASS_LIFE - NOW)) ; echo $DAYS_LEFT
99516
The lastter one means that the password never expire.
This works only with GNU date.
In solaris the command:
doesn't work.
You can try using the following instead:
nawk 'BEGIN {print srand()}'
should give the same output as date +%s under Solaris.
perl -ple 'BEGIN { $\ = "\r\n" }'
Let -p do it's voodoo and do absolutely nothing but set the output record separator :-)
cal | grep -C7 --color=auto $(date +%d)
prettier
Slightly shorter to type
To get the latest information on rpm packages
fmiss() { grep -cR "$*" * | grep -E ':0$' | cut -d: -f1 ; }
When working with a set of files, I often want to see the files I have yet to process. This function gets a list of files that does not contain a pattern. This pattern is usual a marker or finger print in files that have been fixed. It's sister function is:
fhit() { grep -cR "$*" * | grep -vE ':0$' | cut -d: -f1 ; }
which lists files that do have a line that matches the pattern.
pstree -p
Shows a less detailed output, made only of the process tree and their pids.
sudo find /usr/share/hunspell/ -lname '*' -delete
When you right click a text box in Firefox and you have installed a few dictionaries you'll see a loooong list of spellcheckers. Most of them are duplicated (symlinks). This command deletes de duplicates and reduces the list.
du . -mak|sort -n|tail -10
du -m option to not go across mounts (you usually want to run that command to find what to destroy in that partition)
-a option to also list . files
-k to display in kilobytes
sort -n to sort in numerical order, biggest files last
tail -10 to only display biggest 10
mydir(){mkdir -p $1 && cd $1}
Make it a reusable function and add the -p flag to mkdir to create directories recursively
usage: mydir some/dir/to/create
date -d "$(uptime | awk '{gsub(/,/,"",$3);gsub(/:/," hours ",$3); print "- " $3 " minutes"}')"
Get the time and date of the last server reboot
find . -type f -exec awk '/linux/ { printf "%s %s: %s\n",FILENAME,NR,$0; }' {} \;
Functions: awk find printf
Rekursive Grep on Solaris or AIX Systems without GNU egrep -r funcionality
gsettings set org.gnome.desktop.background show-desktop-icons true
rpm -qa --qf '%{name}'
To get the different name field nformation on rpm packages
/originalInstall/gem list | tr -d '(),' | xargs -L 1 sudo ./gemInst.sh
Functions: sudo tr xargs
Migrate gems from one ruby installation to another
gemInst.sh:
if [ "$1" != "$i" ]
echo /newInstall/gem install $1 -v=\"$i\"
/newInstall/gem install $1 -v="$i"
if [ "$?" != "0" ]
echo -e "\n\nGEM INSTALL ERROR: $1\n\n"
echo "$1" > gemInst.err
| perl -n -e 'print "$_" if 1 ... //;'
Functions: command perl
This command line will display the output of , from the first line of output, until the first time it sees a pattern matching .
You could specify the regex pattern /^$/ to look for the first blank line,
or /^foobar/ to look for the first line that starts with the word foobar.
‹ First < 201 202 203 204 205 > Last ›
find . -name .svn -exec rm -r {} +;
for f in $(find /path/to/base -type f | grep -vw CVS); do grep -Hn PATTERN $f; done
Search for a pattern across files in a code base (leaving out CVS directories)
I use this sometimes when ctags won't help.
find -type f -printf "%S\t%p\n" 2>/dev/null | gawk '{if ($1 < 1.0) print $1 $2}'
Functions: find gawk
find sparse files
Prints the path/filename and sparseness of any sparse files (files that use less actual space than their total size because the filesystem treats large blocks of 00 bytes efficiently).
last | awk '{ print $1 }' | sort | uniq -c | grep -v wtmp
To get how many users logged in and logged out and how many times ?
while $t; do for i in `seq 1 30`;do r="$[($RANDOM % 2)]";h="$[($RANDOM % 4)]";if [ $h -eq 1 ]; then v="\e[1m $r";else v="\e[2m $r";fi;v2="$v2 $v";done;echo -e $v2;v2="";done;
You can decrease/increase the bright numbers modifying the $h variable , a higher number less brightness
Another wall matrix :)
ssh tomcat-server ls -l webapp-dir | grep -- '->' | awk ' { print $(NF-2) " " $(NF-1) " " $NF; }'
Functions: awk grep ls ssh
list tomcat webapps
Tomcat webapps are often remote links
curl -s -A "Mozilla" "http://translate.google.com.br/translate_a/t?client=t&text=Hi+world&hl=pt-BR&sl=en&tl=pt&multires=1&ssel=0&tsel=0&sc=1" | awk -F'"' '{print $2}'
oi mundo
Translates a phrase from English to Portuguese
Translates a string from English to Portuguese by using google translator web service.
reboot system boot 2.6.40.4-5.fc15. Fri Sep 30 10:40 - 09:41 (19+23:00)
- shorter
- more readable
MANWIDTH=70 man 7 man
Limit characters per line when viewing manual pages.
Typographically speaking, it's generally the [accepted wisdom][1] that about 60 characters per line makes for optimal reading (would that more Web pages followed this convention!). I know I got tired of reading manpages with text as wide as my screen! However, the command above sets manwidth to 70 rather than 60 because paragraphs in manpages are generally indented.
I recommend the following snippet for your .${SHELL}rc, which sets manwidth to 70 unless your terminal is smaller than 70 characters:
function man () {
if [[ $COLUMNS -gt 70 ]]; then
MANWIDTH=70 command man $*
command man $*
[1]: https://en.wikipedia.org/wiki/Column_(typography)
last | awk '$1!~/wtmp/{logs[$1]++}END{for (i in logs) print i, logs[i]}'
Functions: awk last
to get how many users logged in and logged out and how many times purely using awk
| perl -pe '/
11086128502
7707822
1b0dux
http://twitpic.com/1b0dux
This CLI aims at uploaded a image file (PNG, JPEG, GIF...) to the Web 2.0 Twitpic service (http://twitpic.com/).
A valid Twitter account is needed.
svn pe svn:ignore .
curl -A "Mozilla" "http://translate.google.com/translate_tts?tl=en&q=hello+world" | play -t mp3 -
mpc clear && mpc add http://twit.am:80/listen && mpc play
volume: 44% repeat: off random: off
adding: http://twit.am:80/listen
http://twit.am:80/listen
[playing] #1/1 0:00/0:00 (100%)
Functions: clear
Listen to TWiT with mpd/mpc
This will clear the current playlist.
Almost exactly same command can be used with xmms2:
xmms2 clear && xmms2 add http://twit.am:80/listen && xmms2 play
find -type f -size +0 -mtime +1 -print0|xargs -0r rm -f
Delete all non empty files older than 1 day.
sudo mdutil -a -i off
Indexing disabled.
To re enable just change the "off" for "on"
sort_csn () { echo "${1}" | sed -e "s/,/\n/g"| sort -nu | awk '{printf("%s,",$0)} END {printf("\n")}' | sed -e "s/,$//"; }
$ sort_csn () { echo "${1}" | sed -e "s/,/\n/g"| sort -nu | awk '{printf("%s,",$0)} END {printf("\n")}' | sed -e "s/,$//"; }
$ sort_csn 443,22,80,8200,1533,21,1723,1352,25
21,22,25,80,443,1352,1533,1723,8200
Functions: awk echo sed sort
sort a list of comma separated numbers: sort_csn
"sort_csn" is a function to sort a comma separated list of numbers.
Use the function like this:
sort_csn 443,22,80,8200,1533,21,1723,1352,25
One example where this is useful is when port scanning with nmap and getting a list of open ports in random order. If you use Nessus, you may need to create a scan policy for that set of specific ports and it is clearer to read with the port numbers in ascending order (left to right).
Caveat: no spaces in the comma separated list (just number1,number2,number3,etc).
A variation of this to sort a comma separated list of strings:
sort_css () { echo "${1}" | sed -e "s/,/\n/g"| sort -u | awk '{printf("%s,",$0)} END {printf("\n")}' | sed -e "s/,$//"; }
usage:
sort_css apples,pears,grapes,melons,oranges
apples,grapes,melons,oranges,pears
echo 474e552773204e6f7420556e697821 | sed -e 's/\(.\{2\}\)/\\\\x\1/g' | xargs echo -e
Convert Hex to String
ssh root@server 'tail --max-unchanged-stats=10 -n0 -F /var/log/auth.log ' | grep Accepted | while read l ; do kdialog --title "SSH monitor" --passivepopup "$l" 3; done
Functions: grep read ssh
SSH monitor
cat filename | tr '\n' '\0' | du -hsc ?files0-from=-
Functions: cat du tr
Have a list of directories in a file, ending with newlines and need to run du on it?
du only accepts lines ending with a NUL, which can be a pain to create. This solves that issue.
‹ First < 202 203 204 205 206 > Last ›
perl -le 'chomp($w=`which $ARGV[0]`);$_=`file $w`;while(/link\b/){chomp($_=(split/`/,$_)[1]);chop$_;$w.=" -> $_";$_=`file $_`;}print "\n$w";' COMMAND_NAME
$ perl -le 'chomp($w=`which $ARGV[0]`);$_=`file $w`;while(/link\b/){chomp($_=(split/`/,$_)[1]);chop$_;$w.=" -> $_";$_=`file $_`;}print "\n$w";' vi
/usr/bin/vi -> /etc/alternatives/vi -> /usr/bin/vim.gtk
Show full path followed by a command
This will show you any links that a command follows (unlike 'file -L'), as well as the ultimate binary or script.
Put the name of the command at the very end; this will be passed to perl as the first argument.
For obvious reasons, this doesn't work with aliases or functions.
bind '"\C-e":"\eb `which \ef`\e\C-e"'
Bash$ sudo myscript
Bash$ sudo /home/user/bin/myscript
expand a program-name into an absolute path on the bash command-line, using ctrl-e
Tested with bash v4.1.5 on ubuntu 10.10
Limitations:
as written above, only works for programs with no file extention (i.e 'proggy', but not 'proggy.sh')
because \eb maps to readine function backward-word rather then shell-backward-word (which
is unbinded by default on ubuntu), and correspondingly for \ef.
if you're willing to have Ctrl-f and Ctrl-g taken up too , you can insert the following lines
into ~/.inputrc, in which case invoking Ctrl-e will do the right thing both for "proggy" and "proggy.sh".
-- cut here --
\C-f:shell-backward-word
\C-g:shell-forward-word
"\C-e":"\C-f`which \C-g`\e\C-e"
cat username_lovedtracks.xspf |perl -pe "s/.*(.*)<\/title><creator>(.*)<\/creator>.*/Song: \1 Artist: \2/gi"> titles
Song: Twenty-Three Artist: MC Lars
Song: Listen Close Artist: MC Frontalot
Song: In Arrears Artist: MC Frontalot
Song: Why So Nerdcore Artist: MC GoblinMajick
Change your exported xml love list from last.fm, into Song: songname Artist: artistname
wget ifconfig.me/ip -q -O -
msgfilter --keep-header -i input.po -o empty.po awk -e '{}'
empty a gettext po-file (or, po2pot)
basically create a .pot file from a po-file, ready for translating
psnup -4 -pa4 -Pa4 file.ps file2.ps
printing with psnup
while true; do curl -s http://www.commandlinefu.com/commands/view/3643/log-a-commands-votes | grep 'id="num-votes-' | sed 's;.*id="num-votes-[0-9]*">\([0-9\-]*\)</div>;\1;' >> votes; sleep 10; done
Functions: grep sleep
Log a command's votes
Log a command's votes,
then run:
gnuplot -persist <(echo "plot 'votes' with lines")
gem list --local | python -c "import sys;import re;l=sys.stdin.readlines();x=['config.gem :'+line[:-1][:line.index(' ')] + ' , ' +line[:-1][line.index(' '):].replace('(',':version => ').replace(')','') for line in l];print '\n'.join(x)"
config.gem :actionmailer , :version => 2.3.4
config.gem :actionpack , :version => 2.3.4
config.gem :activerecord , :version => 2.3.4
config.gem :activeresource , :version => 2.3.4
config.gem :activesupport , :version => 2.3.4
config.gem :capistrano , :version => 2.5.10, 2.5.9
config.gem :flexmock , :version => 0.8.6
config.gem :highline , :version => 1.5.1
config.gem :httpclient , :version => 2.1.5.2
config.gem :hypersonic , :version => 1.0
config.gem :libxml-ruby , :version => 1.1.3
config.gem :libxslt-ruby , :version => 0.9.2
config.gem :mysql , :version => 2.8.1
config.gem :net-scp , :version => 1.0.2
config.gem :net-sftp , :version => 2.0.2
config.gem :net-ssh , :version => 2.0.15
config.gem :net-ssh-gateway , :version => 1.0.1
config.gem :rack , :version => 1.0.1
config.gem :rails , :version => 2.3.4
config.gem :rake , :version => 0.8.7
config.gem :rest-client , :version => 1.0.3
config.gem :ruby-xslt , :version => 0.9.6
config.gem :soap4r , :version => 1.5.8
config.gem :sqlite3-ruby , :version => 1.2.5
config.gem :xml-simple , :version => 1.0.12
configify the list of gems on ur machine. the quick hack
Just a small hack for ruby's environment.rb
hdiutil burn foo.iso
Burn an ISO on command line with hdiutil on mac
find . -iname '*TODO*'
Find the files that include a TODO statement within a project
egrep -v "^$|^#" file
Show a script or config file without comments or blank lines
alias dateformatcodes="date --help | sed -n '/^FORMAT/,/%Z/p'"
FORMAT controls the output. Interpreted sequences are:
%% a literal %
%a locale's abbreviated weekday name (e.g., Sun)
%A locale's full weekday name (e.g., Sunday)
%b locale's abbreviated month name (e.g., Jan)
%B locale's full month name (e.g., January)
%c locale's date and time (e.g., Thu Mar 3 23:05:25 2005)
%C century; like %Y, except omit last two digits (e.g., 20)
%d day of month (e.g, 01)
%D date; same as %m/%d/%y
%e day of month, space padded; same as %_d
%F full date; same as %Y-%m-%d
%g last two digits of year of ISO week number (see %G)
%G year of ISO week number (see %V); normally useful only with %V
%h same as %b
%H hour (00..23)
%I hour (01..12)
%j day of year (001..366)
%k hour ( 0..23)
%l hour ( 1..12)
%m month (01..12)
%M minute (00..59)
%n a newline
%N nanoseconds (000000000..999999999)
%p locale's equivalent of either AM or PM; blank if not known
%P like %p, but lower case
%r locale's 12-hour clock time (e.g., 11:11:04 PM)
%s seconds since 1970-01-01 00:00:00 UTC
%S second (00..60)
%t a tab
%T time; same as %H:%M:%S
%u day of week (1..7); 1 is Monday
%U week number of year, with Sunday as first day of week (00..53)
%V ISO week number, with Monday as first day of week (01..53)
%w day of week (0..6); 0 is Sunday
%W week number of year, with Monday as first day of week (00..53)
%x locale's date representation (e.g., 12/31/99)
%X locale's time representation (e.g., 23:13:48)
%y last two digits of year (00..99)
%Y year
%z +hhmm numeric timezone (e.g., -0400)
%:z +hh:mm numeric timezone (e.g., -04:00)
%::z +hh:mm:ss numeric time zone (e.g., -04:00:00)
%:::z numeric time zone with : to necessary precision (e.g., -04, +05:30)
%Z alphabetic time zone abbreviation (e.g., EDT)
Make a quick alias for seeing date's format codes.
Prints out the list of date(1) format codes, for quick easy reference.
dateformatcodes
[ $1 ] && my_dir=$1
Get first argument in a script
If Argument $1 is supplied, assign it to variable. Otherwise continue on.
mplayer -vf-add scale=<SCREEN_WIDTH>:-3:::0.00:0.75 -vf-add expand=:<SCREEN_HEIGHT> -sub <SUBTITLE> <MOVIE>
Put subtitles on black band in Mplayer
psnup -2 file.ps | lpr
Using psnup to get two pages per page
cat file-that-failed-to-download.zip | curl -C - http://www.somewhere.com/file-I-want-to-download.zip >successfully-downloaded.zip
use curl to resume a failed download
If you are downloading a big file (or even a small one) and the connection breaks or times out, use this command in order to RESUME the download where it failed, instead of having to start downloading from the beginning. This is a real win for downloading debian ISO images over a buggy DSL modem.
Take the partially downloaded file and cat it into the STDIN of curl, as shown. Then use the "-C -" option followed by the URL of the file you were originally downloading.
find /var/www/ -type f -name ".htaccess" -exec perl -pi -e 's/AddHandler[\s]*php(4|5)-cgi/AddHandler x-httpd-php\1/' {} \;
replace old htaccess php AddHandler values with new one
Alter "AddHandler php5-cgi .php" and "AddHandler php4-cgi .php" entries to new "AddHandler x-httpd-php5 .php" respective php4 entries in all .htaccess files under /var/www
find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}'
204753
Functions: awk find tail wc xargs
This is really fast :)
time find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}'
real 0m0.191s
user 0m0.068s
sys 0m0.116s
curl -s -c /tmp/cookie -k -u tivo:$MAK --digest "$(curl -s -c /tmp/cookie -k -u tivo:$MAK --digest https://$tivo/nowplaying/index.html | sed 's;.*<a href="\([^"]*\)">Download MPEG-PS</a>.*;\1;' | sed 's|\&|\&|')" | tivodecode -m $MAK -- - > tivo.mpg
Replace $MAK with your MAK see https://www3.tivo.com/tivo-mma/showmakey.do
Replace $tivo with your TiVo's IP
gem list --local | python -c "import sys;import re;l=sys.stdin.readlines();x=['config.gem \"'+line[:-1][:line.index(' ')] + '\" , ' +line[:-1][line.index(' '):].replace('(',':version => \"').replace(')','')+'\"' for line in l];print '\n'.join(x)"
put quotes
ifconfig eth0 | awk '/inet / {print $2}' | cut -d ':' -f2
Functions: awk cut ifconfig
cat $(ls -c | grep ogg | tac ) > directory/test.ogg
Functions: cat grep ls tac
merge ogg file into a new one according to their download time
ifconfig | sed -ne 's/^.*inet \(addr:\)*\([^ ]*\).*/\2/;te' -e 'd;:e' -e '/^127\./d;p'
This also works on non-Linux machines. If you have GNU sed you can do it more elegantly:
ifconfig | sed -n 's/^\s*inet \(addr:\)\?\([^\s]*\) .*/\2/;T;/^127\./d;p'
paste <(cut -f1 log.txt) <(cut -f2- log.txt | shuf)
Functions: cut paste
no log to trace you
google "search terms" #see description for more details
Functions: more
search google on any OS
Inspired by: http://www.commandlinefu.com/commands/view/8744/search-google-on-os-x
#!/bin/bash if [ -n "$1" ] then firefox 'http://www.google.com/search?q="'$1'"' else firefox 'http://www.google.com' fi
Ive aliased this script as 'google' on my system and I can type 'google "search terms"' to open firefox with my search terms. My first post here, if there are any improvements to be made please let me know in the comments.
‹ First < 203 204 205 206 207 > Last ›
awk -F\" '/^DocumentRoot/{print $2}' $(httpd -V | awk -F\" '/\.conf/{print $2}')
perl -MTerm::ReadLine -wde'print "TheAnswer=42\n"'
oneline REPL for perl with warnings and readline support
cd /some/directory \&\& tar cf - | cd /some/directory \&\& tar xvf - */
move files without actually touching them
id=<XXXX>; find /var/spool/postfix/ -name $id -exec less {} \;
Functions: find id less
less an message on a postfix mailsystem with a specific message-id
ffmpeg -i in.mkv -acodec libfaac -ab 128k -ac 2 -vcodec libx264 -vpre max -crf 22 -threads 0 out.mp4
Encode a hq video +10mb/min to an 1mb/min suitable for youtube
http://tinyurl.com/yj7wgqe
tar -cvf - $DIR_TO_BACKUP | tee >(md5sum > backup_md5.txt) > /dev/st0 && mt -f /dev/nst0 bsfm 1 && md5sum -c backup_md5.txt < /dev/st0
Functions: md5sum mt tar tee
Backup to tape, rewind and check md5
Backups $DIR_TO_BACKUP into tape, creating on the fly a MD5SUM file of the backup.
Then rewinds one record on tape and checks if it's well written.
cd () { cdop=""; while [ "$1" != "${1#-}" ]; do cdop="${cdop} ${1}"; shift; done; if [ $# -eq 2 ]; then newdir="${PWD/$1/$2}"; [ -d "${newdir}" ] || { echo "no ${newdir}"; return 1; }; builtin cd $cdop "${newdir}"; else builtin cd $cdop "$@"; fi }
splante@guinness:/tmp/src/x/y/z/> cd src obj
splante@guinness:/tmp/obj/x/y/z/> cd obj src
splante@guinness:/tmp/src/x/y/z/>
Functions: cd echo return
ksh's version of cd has an optional syntax where you can type "cd old new" and it will replace "old" with "new" in your current directory and take you there. This is very handy when you have a parallel directory structure, like source and object directories. As suggested, you can just type cd ${PWD/old/new} to get this in bash, but this function in your .bashrc will let you type the ksh cd syntax and avoid typing the special characters while preserving other cd functionality.
sqlite> select date('now', 'start of year', '+4 months', 'weekday 0', '+7 days');
get Mother's Day
convert -size 1280x720 plasma:fractal background.png
Create a 1280x720 color plasma image. Different each time.
find /pentest/ -type f -iname "*trace*"
/pentest/misc/dradis/server/config/initializers/backtrace_silencers.rb
/pentest/misc/dradis/server/vendor/plugins/wiki_import/test/vendor/mocha-0.9.5/lib/mocha/backtrace_filter.rb
/pentest/enumeration/irpas/itrace.c
/pentest/enumeration/irpas/tctrace
/pentest/enumeration/irpas/itrace
/pentest/enumeration/irpas/itrace.o
/pentest/enumeration/irpas/tctrace.o
/pentest/enumeration/irpas/tctrace.c
/pentest/enumeration/0trace/0trace.sh
/pentest/enumeration/web/whatweb/plugins/TraceWatch.rb
/pentest/exploits/framework2/src/impurity/tracepath.c
/pentest/python/impacket-examples/tracer.py
/pentest/web/mantra/data/extensions/firecookie@janodvarko.cz/chrome/skin/classic/firecookieTrace.css
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/skin/classic/traceConsole.css
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/components/firebug-trace-service.js
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/icons/default/TraceConsole.png
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/content/firebug/traceConsole.js
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/content/firebug/traceConsole.html
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/content/firebug/traceLogFrame.html
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/content/firebug/traceModule.js
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/content/firebug/trace.js
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/content/firebug/traceOverlay.xul
/pentest/web/mantra/data/extensions/firebug@software.joehewitt.com/content/firebug/traceConsole.xul
/pentest/fuzzers/spike/src/autom4te.cache/traces.2
/pentest/fuzzers/spike/src/autom4te.cache/traces.1
/pentest/fuzzers/spike/src/autom4te.cache/traces.0
/pentest/fuzzers/rfuzz/doc/mongrel-1.1.5/ri/MongrelDbg/begin_trace-c.yaml
/pentest/fuzzers/rfuzz/doc/mongrel-1.1.5/ri/MongrelDbg/trace-c.yaml
/pentest/fuzzers/rfuzz/doc/mongrel-1.1.5/ri/MongrelDbg/end_trace-c.yaml
/pentest/libs/libhijack/src/ptrace.c
/pentest/libs/libhijack/include/hijack_ptrace.h
/pentest/scanners/unicornscan/src/test_scripts/traceroute_fmtcat.sh
/pentest/telephony/warvox/web/config/initializers/.svn/text-base/backtrace_silencers.rb.svn-base
/pentest/telephony/warvox/web/config/initializers/backtrace_silencers.rb
find command usage
you can find all "trace" phrases within everywhere else under the pentest directory..
mailq | grep DrWEB | awk {'print $1'} | sed s/*//g | postsuper -d -
Functions: awk grep mailq sed
delete all DrWeb status, failure and other messages on a postfix server
find . -not \( -name .svn -prune \) -type f | xargs zip XXXXX.zip
cvs up 2>&1 | grep --color 'U \|P \|A \|R \|M \|C \|? '
Filter output with default cvs update status (not only modified files 'M')
ffmpeg -i initial.mkv -acodec libvorbis -ab 128k -ac 2 -vcodec libx264 -vpre max -crf 22 -threads 0 final.mkv
Encode mkv file to ogg+h264+mkv
du -h --max-depth=1 | sort -hr
7.4G .
2.4G ./lib64
2.1G ./share
1.1G ./src
534M ./lib
530M ./local
508M ./bin
219M ./java
74M ./sbin
54M ./include
16K ./x86_64-suse-linux
16K ./X11R6
8.0K ./log
Credit goes to brun65i but he posted it as a comment instead as an alternative. I hadn't noticed the -h option on sort before and this seems like the cleanest alternative. Thanks Brun65i!
# su - <user> ; script /dev/null ; screen -r
Functions: screen script su
resume other user's screen session via su, without pty error
Normally, if you su to another user from root and try to resume that other user's screen session, you will get an error like "Cannot open your terminal '/dev/pts/0' - please check." This is because the other user doesn't have permission for root's pty. You can get around this by running a "script" session as the new user, before trying to resume the screen session. Note you will have to execute each of the three commands separately, not all on the same line as shown here.
Credit: I found this at http://www.hjackson.org/blog/archives/2008/11/29/cannot-open-your-terminal-dev-pts-please-check.
f(){ if [ "$PWD" != "$LPWD" ];then LPWD="$PWD"; tmux rename-window ${PWD//*\//}; fi }; export PROMPT_COMMAND=f;
Automatically rename tmux window using the current working directory
Adds a function that runs every time the prompt is rendered. The function grabs the CWD from PWD and issues a command to tmux to change the current window
ls -la | awk '{print $5, " " ,$9}' | sort -rn
file sizes of current directory
for i in `grep "unable to stat" /var/log/syslog | cut -d "/" -f 3 | sort | uniq`; do find /var/qmail/queue -name $i -type f -exec rm -v {} \; ; done
Functions: cut find rm sort
purge old stale messages on a qmail queue
curl -L -s `curl -s http://www.2600.com/oth-broadband.xml` | xmlstarlet sel -t -m "//enclosure[1]" -v "@url" -n | head -n 1` | ssh -t [user]@[host] "mpg123 -"
High Preformance MPEG 1.0/2.0/2.5 Audio Player for Layer 1, 2 and 3.
Version 0.59s-mh4 (2000/Oct/27). Written and copyrights by Michael Hipp.
Uses code from various people. See 'README' for more!
THIS SOFTWARE COMES WITH ABSOLUTELY NO WARRANTY! USE AT YOUR OWN RISK!
Playing MPEG stream from standard input ...
Found new ID3 Header
MPEG 2.0 layer III, 64 kbit/s, 22050 Hz joint-stereo
Functions: head ssh
Play 2600 off the hook over ssh
Ever wanted to stream your favorite podcast across the network, well now you can.
This command will parse the iTunes enabled podcast and stream the latest episode across the network through ssh encryption.
ffmpeg -i foo.mp3 -vol 20 -acodec libmp3lame bar.mp3
Set volume to a mp3 file
echo "Terrorist threat level: $(curl -s 'http://www.dhs.gov/dhspublic/getAdvisoryCondition' | awk -F\" 'NR==2{ print $2 }')"
Terrorist threat level: ELEVATED
Used curl instead of wget (minor change)
Used the full-url instead of the shortened one (in case is.gd goes down/empties their cache)
turned the tail | awk bit into a single awk command.
type () { if [ "$1" = "-c" ]; then shift; for f in "$@"; do ff=$(builtin type -p "$f"); readlink -f "$ff"; done; else builtin type $typeopts "$@"; fi; }
splante@linux3101:~> type -c java
/usr/java/jdk1.6.0_21/jre/bin/java
splante@linux3101:~> type java
java is /usr/bin/java
splante@linux3101:~> ls -l /usr/bin/java /etc/alternatives/java /etc/alternatives/jre /etc/alternatives/jdk /etc/alternatives/jdk_1.6.21/jre/bin/java
lrwxrwxrwx 1 root root 22 Jun 25 2010 /usr/bin/java -> /etc/alternatives/java
lrwxrwxrwx 1 root root 12 Jul 21 2010 /etc/alternatives/java -> jre/bin/java
lrwxrwxrwx 1 root root 7 Jul 21 2010 /etc/alternatives/jre -> jdk/jre
lrwxrwxrwx 1 root root 10 Jul 21 2010 /etc/alternatives/jdk -> jdk_1.6.21
-rwxr-xr-x 1 root root 47308 Jun 22 2010 /etc/alternatives/jdk_1.6.21/jre/bin/java
Functions: readlink type
Adds "-c" canonical option to bash "type" builtin command to follow symbolic links
The "type" builtin command is handy to find out what executable will be used if you issue a command. But on some distros, particularly when using /etc/alternatives, certain executables get buried under layers and layers of symbolic links and it becomes hard to find which one.
If you put the above command in your .bashrc, it adds a "-c" option to the type command that will weed through the symbolic links and prints the actual file that will be executed.
uptime | cut -d "," -f 1 | cut -d " " -f 4-
Functions: cut uptime
‹ First < 204 205 206 207 208 > Last ›
gnuplot -p <(echo "set terminal wxt size `xrandr|grep -P '\s{3}(\d+x\d+).*\+$'|tr -s ' ' '\t'|cut -f2|sort -n|tail -n1|tr 'x' ','`; set logscale y; set style data hist; set xtic rot by -90; plot '<(stat -c \"%n %s\" *)' u 2:xtic(1)")
Log scaled histogram so that you can see large files even if there is a single HUGE file in the directory. Also makes sure the histogram is fullscreen for best chance of readable file names.
screen -ls | grep main && urxvt -name screen -e screen -x main || urxvt -name screen -e screen -R -S main
Functions: grep screen
Start urxvt and do whatever is needed to open the screen session named "main"
Open a terminal (urxvt in this case) to connect to a screen session (named "main") and create the screen session if necessary.
for i in *jpg; do jpeginfo -c $i | grep -E "WARNING|ERROR" | cut -d " " -f 1 | xargs -I '{}' find /mnt/sourcerep -name {} -type f -print0 | xargs -0 -I '{}' cp -f {} ./ ; done
Functions: cp cut find grep xargs
sync a directory of corrupted jpeg with a source directory
Find all corrupted jpeg in the current directory, find a file with the same name in a source directory hierarchy and copy it over the corrupted jpeg file.
Convenient to run on a large bunch of jpeg files copied from an unsure medium.
Needs the jpeginfo tool, found in the jpeginfo package (on debian at least).
curl -L -s `curl -s [http://podcast.com/show.rss]` | xmlstarlet sel -t -m "//enclosure[1]" -v "@url" -n | head -n 1` | ssh -t [user]@[host] "mpg123 -"
Play a podcast via XPath and mpg123
Gets the latest podcast show from from your favorite Podcast. Uses curl and xmlstarlet.
Make sure you change out the items between brackets.
sed '/'"<opening tag>"'/,/'"<closing tag>"'/{/'"<closing tag>"'/d;p};d' "<file>"
daveqb@localhost /tmp $
cat test
one two three
four
five
six
seven
sed '/'"four"'/,/'"six"'/{/'"six"'/d;p};d' "test"
This line does not include your closing tag in the output.
wget -O/dev/null -q URLtoCheck && echo exists || echo not exist
exists / not exist
put your link [url] to check if exist the remote file
jot 4 | awk '{ print "wc -l /usr/share/dict/words | awk '"'"'{ print \"echo $[ $RANDOM * $RANDOM % \" $1 \"]\" }'"'"' | bash | awk '"'"'{ print \"sed -n \" $1 \"p /usr/share/dict/words\" }'"'"' | bash" }' | bash | tr -d '\n' | sed 's/$/\n/'
rackettwiseheartedgellytutoressn
Functions: awk bash sed tr
So I use OSX and don't have the shuf command. This is what I could come up with.
This command assumes /usr/share/dict/words does not surpass 137,817,948 lines and line selection is NOT uniformly random.
unzip -l filename.zip |awk '{ if($4 != "Name" && $4 != "----") print $4}'|xargs -t rm -rf {}
rm -rf {} OLE/ OLE/PPS/ OLE/PPS/File.php OLE/PPS/Root.php OLE/package.xml OLE/OLE.php OLE/PPS.php Spreadsheet/ Spreadsheet/Excel/ Spreadsheet/Excel/Writer.php Spreadsheet/Excel/package.xml Spreadsheet/Excel/Writer/ Spreadsheet/Excel/Writer/Parser.php Spreadsheet/Excel/Writer/Workbook.php Spreadsheet/Excel/Writer/Validator.php Spreadsheet/Excel/Writer/Format.php Spreadsheet/Excel/Writer/Worksheet.php Spreadsheet/Excel/Writer/BIFFwriter.php CSVtoXLS.php example.csv README.txt
Functions: awk rm xargs
un-unzip a file
Sometimes you unzip a file that has no root folder and it spews files all over the place. This will clean up all of those files by deleting them.
find /etc/ /pentest/ -type f -iname "*sql*" | grep map
root@bt:~# find /etc/ /pentest/ -type f -iname "*sql*" | grep map
/pentest/enumeration/lanmap2/data/map-TCP-SYN.sql
/pentest/enumeration/lanmap2/data/map-IPv4.sql
/pentest/enumeration/lanmap2/data/map-DNS-TXT.sql
/pentest/enumeration/lanmap2/data/gen-db.sql
/pentest/enumeration/lanmap2/data/map-BOOTP-VendorClass.sql
/pentest/enumeration/lanmap2/data/map-BOOTP-Fingerprint.sql
/pentest/enumeration/lanmap2/data/map-ICMP-Echo-Fingerprint.sql
/pentest/enumeration/lanmap2/data/map-CDP.sql
/pentest/enumeration/lanmap2/data/map-BROWSE.sql
/pentest/enumeration/lanmap2/data/map-SSDP.sql
/pentest/enumeration/lanmap2/lib/libluasqlite3-loader.lua.in
find usage
you can find a special things(with defined -iname "*sql*") from in most of one direcroty(for example from both /etc/ and /pentest/) and then you can want to grep only include "map" word
nc -l -p portnumber
This is the syntax for older versions of netcat.
find . -type f -mtime -14 -exec ls -ltd \{\} \; | less
-rw-r--r-- 1 george george 75 2010-05-24 07:37 ./.update-notifier/hooks_seen
-rw-r--r-- 1 george george 61440 2010-05-14 15:54 ./.pulse/bfd54adae3f2c2b797ed9b374b0d221f-device-volumes.tdb
-rw-r--r-- 1 george george 42 2010-05-27 07:33 ./.pulse/bfd54adae3f2c2b797ed9b374b0d221f-default-source
-rw-r--r-- 1 george george 43 2010-05-27 07:33 ./.pulse/bfd54adae3f2c2b797ed9b374b0d221f-default-sink
-rw------- 1 george george 6917 2010-05-27 06:09 ./.recently-used.xbel
Find files modified in the last N days; list sorted by time
What *have* I been working on for the last 2 weeks...
ip addr show eth0 | awk '/inet / {FS = "/"; $0 = $2; print $1}'
Combines wgzhao's grep | awk | sed into one awk command.
cat b1.avi b2.avi b3.avi b4.avi b5.avi b6.avi b7.avi > output.avi; mencoder -forceidx -oac copy -ovc copy output.avi -o output_final.avi; rm output.avi
Functions: cat rm
Join avi files
sshfs /root/Desktop/mountdirectory root@remotehost:/etc/
sshfs usage
you can use this command for mounting local directory to a remost directory..
find ./source -depth -print | cpio -cvo> /destination/source_data.cpio; cd /destination; cpio -icvmdI ./source_data.cpio; rm -rf ./source_data.cpio
Functions: cd cpio find rm
copying data with cpio
Copy data to the destination using commands such as cpio (recommended), tar, rsync, ufsdump, or ufsrestore.
Let the source directory be /source, and let the destination directory be /destination.
# cd /source
# cd ..
# find ./source -depth -print | cpio -cvo> /destination/source_data.cpio
# cd /destination
# cpio -icvmdI ./source_data.cpio
# rm -rf ./source_data.cpio
awk 'BEGIN {for(i=1;i<=100;i++)sum+=i}; END {print sum}' /dev/null
Calculating series with awk only, no need for seq: add numbers from 1 to 100
awk 'BEGIN {for(i=1;i<=19;i+=2)sum+=i}; END {print sum}' /dev/null # displays 100
awk 'BEGIN {for(i=1;i<=10;i++)sum+=1/(2**i)}; END {print sum}' /dev/null # displays 0.999023
exiftool -d %Y-%m-%d_%H.%M.%S%%-c.%%e "-filename<CreateDate" .
Rename all images in current directory to filename based on year, month, day and time based on exif information
mpc playlist | grep -in bar
54: Foo_song_with_bar_in_it
Finds the track no of songs, to be played
perl -pi -e 's:^V^M::g' <filenames>
That "^M" is Ctrl-M, which is a carriage return, and is not needed in Unix file systems.
Where ^V is actually Ctrl-V and ^M is actually Ctrl-M (you must type these yourself, don't just copy and paste this command). ^V will not be displayed on your screen.
find . -type d -exec chmod 755 {} \;
Change permissions of every directory in current directory
"find . -type d -print0 | xargs -0 chmod 755"
thanks masterofdisaster
grep -Eho '<[a-ZA-Z_][a-zA-Z0-9_-:]*' * | sort -u | cut -c2-
body
br
center
div
fieldset
font
form
func:function
func:result
h1
h2
h4
head
html
img
input
label
li
link
meta
noscript
option
p
sc
select
span
strong
style
table
tbody
td
textarea
th
title
tr
ul
xsl:apply-templates
xsl:attribute
xsl:call-template
xsl:choose
xsl:copy-of
xsl:for-each
xsl:if
xsl:include
xsl:otherwise
xsl:param
xsl:stylesheet
xsl:template
xsl:text
xsl:value-of
xsl:variable
xsl:when
xsl:with-param
This one will work a little better, the regular expressions it is not 100% accurate for XML parsing but it will suffice any XML valid document for sure.
netstat -nt | awk -F":" '{print $2}' | sort | uniq -c
count connections, group by IP and port
for F in *.pdf ; do qpdf --password=your_password --decrypt "$F" "$(basename $F .pdf)-nopw.pdf" ; done
Remove password from PDF
This command line will remove password from all PDF files in the current folder. It use qpdf.
ftp>!w
ftp> !w
10:38PM up 32 mins, 2 users, load averages: 0.45, 0.16, 0.06
USER TTY FROM LOGIN@ IDLE WHAT
Functions: ftp
Run command in an ftp session
By putting ! in front of a command, we are able to run it from an ftp session.
watch -n 900 "notify-send -t 10000 'Look away. Rest your eyes'"
Remind yourself every 15 minutes (repeated reminders)
1) -n option of watch accepts seconds
2) -t option of notify-send accepts milliseconds
3) All quotes stated in the given example are required if notification
message is more than a word.
4) I couldn't get this to run in background (use of & at the end fails). Any
suggestions/improvements welcome.
‹ First < 205 206 207 208 209 > Last ›
find / -type f -size +548576 -printf "%s:%h%f\n"
you can change the size :)
awk '$3==$4' /etc/passwd
Print all lines from a file that has the same N th and M th column
grep -n log4j MainPm.java | sed -e 's/^\([^:]*\):\(.*\)/\2 \1/'
import org.apache.log4j.LogManager; 11
import org.apache.log4j.Logger; 12
move linenumbers of grep output to end of line
Uses sed with a regex to move the linenumbers to the line end. The plain regex (w/o escapes) looks like that:
^([^:]*):(.*)
diff dir1 dir2 | diffstat
$ diff vpn_hebex vpn_hebex2 | diffstat
vpn_hebex/ipsec.d |only
vpn_hebex2/hebex-route.ip-down | 7 +++++++
2 files changed, 7 insertions(+)
See which files differ in a diff
See which files differ in a diff, and how many changes there are. Very useful when you have tons of differences.
dd if=/dev/zero of=/dev/sdb bs=446 count=1
Remove the boot loader from a usb stick
If you don't want your computer to try to boot form a USB stick that used to be used as a boot device (maybe for a live linux distro), you will have to remove the boot loader from your stick other wise the boot will fail each time the device is attached to your PC.
gitstart () { if ! [[ -d "$@" ]]; then mkdir -p "$@" && cd "$@" && git init; else cd "$@" && git init; fi }
Makes a project directory, unless it exists; changes into the dir, and creates an empty git repository, all in one command
gitstart ~/path/to/dir
Initialized empty Git repository in /home/user/path/to/dir/.git/
(for FILE in $@; do echo $[100*++x/$#]; command-for-each-parameter; done)|zenity --progress --auto-close
# Example usage for rotating images:
(for FILE in $@; do echo $[100*++x/$#]; mogrify -rotate -90 "$FILE"; done)|zenity --progress --auto-close
call with:
$ ./script file1.gif file2.jpg file3.png ...
Zenity percent progressbar for scripts accepting parameters
Shows a zenity progressbar for each file in a script, see the samble output. Works with any number, less, equal or greater than 100.
x is not initially defined. If used twice in the script, set it:
x=0
(for FILE in $@; do echo $[100*++x/$#]; command... "$FILE"; done)|zenity --progress --auto-close
watch !!
monitor the last command run
tar -tvjf backup.tar.bz2 | sort -nrk 3 | head
Functions: sort tar
Shows the largest files in your archives
pwsafe -qa "gpg keys"."$(finger `whoami` | grep Name | awk '{ print $4" "$5 }')"
Enter passphrase for $HOME/.pwsafe.dat: _
Safely store your gpg key passphrase.
From time to time one forgets either thier gpg key or other passphrases. This can be very problematic in most cases. But luckily there's this script. Its based off of pwsafe which is a unix commandline program that manages encrypted password databases. For more info on pwsafe visit, http://nsd.dyndns.org/pwsafe/.
What this script does is it will help you store all your passphrases for later on and allow you to copy it to your clipboard so you can just paste it in, all with one password. Pretty neat no?
You can find future releases of this and many more scripts at The Teachings of Master Denzuko - denzuko.wordpress.com.
perl -e '$p=qr!(?:0|1\d{0,2}|2(?:[0-4]\d?|5[0-5]?|[6-9])?|[3-9]\d?)!;print((shift=~m/^$p\.$p\.$p\.$p$/)?1:0);' 123.123.123.123
Test if the given argument is a valid ip address.
This command will output 1 if the given argument is a valid ip address and 0 if it is not.
export PROMPT_COMMAND='( x=$? ; let x!=0 && echo shell returned $x )'
[marcio@localhost ~]$ export PROMPT_COMMAND='( x=$? ; let x!=0 && echo shell returned $x )'
[marcio@localhost ~]$ ls xyz
ls: cannot access xyz: No such file or directory
shell returned 2
[marcio@localhost ~]$
Receiving alerts about commands who exit with failure
If a command returns a error code, you will know
b(){ echo "scale=${2:-2}; $1" | bc -l; }
b 6*7 -> 42
b "e(1)" 6 -> 2.718281
a=1; b=1/7; b $a/$b -> 0.14
floating point bash calculator w/o precision
terms inclosing '()' must be enclosed by "" (soft quotes)
bash variables must be referenced: b $x/$y
ugly bracket checking (balanced, fractions...)
default precision 2
cat /proc/acpi/thermal_zone/*/temperature
Show thermal info
A quick way of know the temperature info.
od --format=x1 --address-radix=x mybinaryfile
hexadecimal dump of a file as it is on disk with hexadecimal offsets
--format=x1 makes sure that 2 byte words do not get swapped to little-endian and that the output is exactly like the bytes are stored on disk.
--address-radix=x makes sure offsets are not output in default octal base but in hex.
--address-radix=n can also be used to only output data without offsets
for i in `cat names.txt`; do host -r $i [nameserver]; done
ifconfig | grep cast | cut -d':' -f2 | cut -d' ' -f1
10.10.10.2
10.10.20.250
show your private/local ip address
Gets the IP addresses of all interfaces except loopback. Cuts out all of the extra text.
Shorter than the other options, and much easier to type.
'ifconfig | grep cast' is enough to get the IP address, but it doesn't strip the rest of the junk out.
macchanger -A (nic)
You have to install the package macchanger but this command will create a random mac from a list of known manufacturers. If you want to make a complete random mac, use the -r option .
tethereal -i eth0 -R 'iax2 && ip.addr==10.162.78.162' -w /tmp/iax2.pcap
use ethereal to generate a pcap file of a VOIP call
use ethereal to generate a pcap file of and iax2 VOIP channel on the specified interface with a particular host
git filter-branch --index-filter 'git rm --cached --ignore-unmatch FileToRemove' HEAD
lsoave@ubuntu:~/rails/heroku/$ git filter-branch --index-filter 'git rm --cached --ignore-unmatch README.S3.settings' HEADRewrite b308c8301b3075aa56793e08127452e201b4f0ff (23/30)rm 'README.S3.settings'
Rewrite 9967e7a1a422a7247d149c6225e14d03df7d6c67 (24/30)rm 'README.S3.settings'
Rewrite 0b0ed75fdf09531565ed2970fa9a49cfa06442de (25/30)rm 'README.S3.settings'
Rewrite e8c512abaf50c3025eb996fd93b705289852cf31 (26/30)rm 'README.S3.settings'
Rewrite b09ca619e31b5bbedbc956bdf93fb8e8856a18c6 (27/30)rm 'README.S3.settings'
Rewrite f270fafaa5962e255701b2bf14c1d3f2a4d50814 (28/30)rm 'README.S3.settings'
Rewrite 74bbf277a98d0aa9b93e719063f06890fd155179 (29/30)rm 'README.S3.settings'
Rewrite f57b3079e967ea641bfedd18e1c2a80d70805906 (30/30)
Ref 'refs/heads/heroku.dev' was rewritten
lsoave@ubuntu:~/rails/heroku/$
Removing sensitive data from the entire repo history.
Removing sensitive data
sudo env ARCHFLAGS="-arch x86_64" gem install mysql
Functions: env install sudo
Install mysql-2.8.1 rubygem on Mac OS X 10.6 (Snow Leopard)
cat /proc/<PID>/environ
USER=rootLOGNAME=rootHOME=/rootPATH=/usr/bin:/bin:/usr/sbin:/sbinMAIL=/var/mail/rootSHELL=/bin/bashSSH_CLIENT=192.168.8.2 29998 22SSH_CONNECTION=192.168.8.2 29998 192.168.8.12 22SSH_TTY=/dev/pts/0TERM=linuxSSH_AUTH_SOCK=/tmp/ssh-IJZxdX8645/
find out about a process
Good to find out about hostile processes
find . -type d -execdir du -sh '{}' ';' | grep -E "[0-9]+K" | sed 's/^[0-9\.]\+K[\t ]\+//' | tr "\n" "\0" | xargs -0 rm -rf
Functions: du find grep rm sed tr xargs
Remove all directories less than 1 MB in size in or below current directory
sed -i.bak '/^[[:space:]]*$/d' file_name
$ cat aFile
This is an example file
^ with a blank line
$ sed -i.bak '/^[[:space:]]*$/d' aFile
$ cat aFile.bak
Remove blank lines from files, even if some of the lines have whitespace (spaces, tabs, etc.). Also creates a .bak copy of the original file. Works on Mac also.
Thanks to those all those who left comments.
awk '{print}' | espeak -v pt -stdin
stdin speaker via espeak
Speaks whatever comes in via stdin (-v pt = portuguese, default = englisg)
..speech part of keyboard event talker. Made to accomplish a simple alarm central based on a cheap keyboard circuit. This way I have one zone per direct keypress. Depends on keypress.sh. It speaks out loud wich zone (key) has been pressed ( faulted ). Here is keypress.sh :
# keypress.sh: Detect a user keypress ("hot keys").
old_tty_settings=$(stty -g) # Save old settings (why?).
stty -icanon
Keypress=$(head -c1) # or $(dd bs=1 count=1 2> /dev/null)
# on non-GNU systems
aplay -q /home/mm/bash/beep-1.wav
echo "Chamada quarto \""$Keypress"\"."
stty "$old_tty_settings" # Restore old settings.
# Thanks, Stephane Chazelas.
‹ First < 206 207 208 209 210 > Last ›
find /home/bubo/ -type f \( -iname \*.jpg -print0 , -iname \*.png -print0 , -iname \*gif -print0 \) | du -cm --files0-from - | tail -1
Functions: du find tail
show how much diskspace all images in a given directory need
VBoxManage openmedium dvd "/path/name.iso"
Create a virtual disk (CD/DVD) in VirtualBox
No comment... it's easy! Using the VBoxManage list and the switch 'hdds' or 'dvds' you can show the list of hard disks and DVD registered on the system.
lynx -dump 'https://bridges.torproject.org' | sed '/^bridge [0-9\.][0-9\.]*:[0-9][0-9]*/!d'
get tor bridges
dig @somenameserver.net somedomainname.net axfr
Check if your domain name is suspectable to axfr attacks.
function whichpkg { dpkg -S $1 | egrep -w $(which $1)$; }
$ whichpkg cron
cron: /usr/sbin/cron
$ whichpkg ls
$ whichpkg intentionally-non-existent
dpkg: *intentionally-non-existent* not found.
Functions: egrep which
Similar to command 7822, but handles errors gracefully.
find . -name "directory_name" -type d -print0 | xargs -0 -i rm -rf {}
find specified directory and delete it recursively including directories with spaces
killall -r 'Activ'
Kill a process by its partial name (BSD/Mac)
This kills Activity Monitor
echo Faltan `curl http://www.elproximoferiado.com.ar/index.php?country=AR -silent | grep contador | cut -f2 -d">" | cut -f1 -d"<"` dias para el proximo feriado
Count the days until the next holiday in Argentina.
Execute a command with the last parameter of a previous command
Suppose that you had change in a directory like /home/user/mycode/code, and now you need to list it, instead of type entire path again, use ls !$ to recall path and list. Useful with many commands, this is only an example. (In this case, same result can be achivied with ls .)
sed 's/\([0-9]*\)\.\([0-9]*\)\.\([0-9]*\)\.\([0-9]*\).in-addr.arpa domain name pointer\(.*\)\./\4.\3.\2.\1\5/' \ lookups.txt
Reverse DNS lookups
Reverse DNS lookups, from a file with list of IP's, here the file is called lookups.txt
echo -e "${PATH//://\n}" >/tmp/allpath; grep -Fh -f /tmp/allpath /var/lib/dpkg/info/*.list|grep -vxh -f /tmp/allpath >/tmp/installedinpath ; find ${PATH//:/ } |grep -Fxv -f /tmp/installedinpath
Functions: echo find grep
find files in $PATH that were not installed through dpkg
OS: Debian based (or those that use dpkg)
Equivalent to doing a dpkg -S on each file in $PATH, but way faster.
May report files generated though postinstall scripts and such. For example . It will report /usr/bin/vim .. which is not not a file installed directly by dpkg, but a link generated by alternatives hooks
calc() { awk 'BEGIN { OFMT="%f"; print '"$*"'; exit}'; }
floating point shell calculator
awk '/^--- Day changed (.*)/ {st=""; for (i=0;i<ar[date];i++) {st=st"*"} print date" "st; date=$7"-"$5"-"$6} /> emergency/ {ar[date]++} END {st=""; for (i=0;i<ar[date];i++) {st=st"*"}; print date" "st}' #engineyard.log
2009-Jun-25 **
2009-Jun-26 ***
2009-Jun-27
2009-Jun-28 *
2009-Jun-29 *
2009-Jun-30 *
2009-Jul-01
2009-Jul-02 *
2009-Jul-03
2009-Jul-04
2009-Jul-05
2009-Jul-06 ***
2009-Jul-07 *****
2009-Jul-08 ***
2009-Jul-09 ***
2009-Jul-10 *****
2009-Jul-11
2009-Jul-12
2009-Jul-13 **
2009-Jul-14 *****
2009-Jul-15
2009-Jul-16
2009-Jul-17 *
2009-Jul-18 *
2009-Jul-19 *
2009-Jul-20 ****
2009-Jul-21 *
2009-Jul-22 ***
2009-Jul-24 **
2009-Jul-25 **
2009-Jul-26 ****
irssi log histogram
This awk command prints a histogram of the number of times 'emergency' is the first word in a line, per day, in an irssi (IRC client) log file.
wget -r -np -nd -A.pdf --user *** --password *** http://www.domain.tld/courses/***/download/
Replace *** with the appropiate values
function summpkg { dpkg -s $(dpkg -S $1 | egrep -w $(which $1)$ | awk -F: '{print $1}') ; }
$ summpkg nm
Package: binutils
Status: install ok installed
Priority: optional
Section: devel
Installed-Size: 9592
Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
Architecture: i386
Version: 2.20.1-3ubuntu7.1
Replaces: binutils-gold (<< 2.20-5)
Provides: elf-binutils
Depends: libc6 (>= 2.11), zlib1g (>= 1:1.1.4)
Suggests: binutils-doc (>= 2.20.1-3ubuntu7.1)
Conflicts: elf-binutils, gas, modutils (<< 2.4.19-1)
Description: The GNU assembler, linker and binary utilities
The programs in this package are used to assemble, link and manipulate
binary and object files. They may be used in conjunction with a compiler
and various libraries to build programs.
Original-Maintainer: Matthias Klose <doko@debian.org>
Functions: awk egrep which
This version builds on my command 8776 (Find the package a command belongs to on debian-based distros). So if you use that command to find package name then you could alternatively use following for
package summary:
function summpkg { dpkg -s $(whichpkg $1 | awk -F: '{print $1}'); }
7z a -mx=9 -ms=on archive.7z files_for_archiving/
m6@yoda:/var$ 7z a -mx=9 -ms=on archive.7z files_for_archiving/
7-Zip 9.04 beta Copyright (c) 1999-2009 Igor Pavlov 2009-05-30
p7zip Version 9.04 (locale=en_US.utf8,Utf16=on,HugeFiles=on,2 CPUs)
Scanning
Creating archive archive.7z
Compressing system/cache/b92c3fe103ae66295e73775cf4a376b1
Compressing i/desktop_branded/__200x142__
Compressing i/laptops/__200x142__
Compressing i/memory_cards/__200x142__
Create Solid Archive (best compression) with 7z
Creates a solid archive with the highest possible compression (Ultra). Advantage of 7z is that it will use all the processor cores to create the archive. (Ok. at least version 9.04 does)
mount|grep -e '//'|cut -d ' ' -f3| xargs -I {} umount {}
Functions: cut grep mount umount xargs
Unmount all mounted SAMBA/Windows shares
This is a handy command to put into ~/.bash_logout to automatically un-mount windows shares whenever the user logs out. If you use this on as a non-root account then you'll need to append sudo before umount and the user will need to have the appropriate sudoer rights to run the /bin/umount command.
find /path -name \*.php -user nobody -exec grep -nH whatever {} \;
grep selectively
allows to grep very narrow subset of files
List installed rpm named and arquitecture.
sudo cat /usr/share/icons/*/*/* > /dev/dsp
Playing raw data 'stdin' : Unsigned 8 bit, Rate 8000 Hz, Mono
Functions: cat sudo
Play music from pure data
Plays the sound of the file, should sound like *some* kind of music, most files sound like static but some are really cool.
variations:
sudo cat /dev/sda > /dev/dsp sudo cat /dev/sda5 | aplay
Check out http://bbs.archlinux.org/viewtopic.php?id=70937 for more variations!
semi-dupe--like http://www.commandlinefu.com/commands/view/985/generate-white-noise but with different syntax and program.
find / -type f -exec wc -c {} \; | sort -nr | head -100
Functions: find head sort wc
List files and sizes
xdg-open .
show current directory
Opens a file or URL in the user's preferred application.
command -geometry 120x30+1280+0
Open your application to a specific size and location
open an application to wherever you like on your current display. the first set of #'s (120x30) denotes size of window opened in, and the second set (+1280+0) identifies the location. Either set can be used alone, or with the other. Also, opening gnome-terminal with this option requires it to be "--geometry" for some reason.
curl -u user:passwd -T /home/dir/local_file_to_upload ftp://your_host.com/subdir/
upload a file via ftp
echo $(( $( cat count.txt | tr "\n" "+" | xargs -I{} echo {} 0 ) ))
1653
Functions: cat echo tr xargs
if you, like me, do not have the numsum, this way can do the same.
‹ First < 207 208 209 210 211 > Last ›
logfile=/var/log/gputemp.log; timestamp=$( date +%T );temps=$(nvidia-smi -lsa | grep Temperature | awk -F: ' { print $2 } '| cut -c2-4 | tr "\n" " ");echo "${timestamp} ${temps}" >> ${logfile}
Functions: awk cut date grep tr
Create a log file of Nvidia graphics card temperatures using nvidia-smi
perl -MURI::Escape -e 'print uri_escape("String encoded to a url");'
String%20encoded%20to%20a%20url
encode a text to url_encoded format
usefull for posts via wget
openssl pkcs12 -info -nodes -in /path/to/encryptedp12 > /path/to/asciip12
Convert pkcs12 Certificate to ASCII for use in PHP
find <folder> -type f -name '*.jpg' -exec bash -c 'ext="${0##*.}";path="$(dirname "$0")";name="$(basename "$0"|sed "s/.jpg//")";folder="$(dirname "$0"|tr / \\n |tail -1)";new="${path}/${name}_${folder}.${ext}"; mv "$0" "${new}"' {} \;
find pictures and renames them appending the containing folder name
find pictures recursively in a specified folder and renames the file name to originalname_containingfoldername.jpg
summpkg() { rpm -qfi "$@"; }
~$ summpkg /bin/sort
Name : coreutils
Version : 8.10
Release : 2.fc15
Architecture: x86_64
Install Date: Fri 13 May 2011 12:03:43 BST
Group : System Environment/Base
Size : 13612880
License : GPLv3+
Signature : RSA/SHA256, Wed 09 Feb 2011 11:48:28 GMT, Key ID b4ebf579069c8460
Source RPM : coreutils-8.10-2.fc15.src.rpm
Build Date : Tue 08 Feb 2011 11:50:28 GMT
Build Host : x86-19.phx2.fedoraproject.org
Relocations : (not relocatable)
Vendor : Fedora Project
URL : http://www.gnu.org/software/coreutils/
Summary : A set of basic GNU tools commonly used in shell scripts
These are the GNU core utilities. This package is the combination of
the old GNU fileutils, sh-utils, and textutils packages.
A file's rpm-package details
Find information about the rpm package which owns a certain file.
for i in *; do file $i | grep -q ELF || continue; readelf -d $i | grep -q RPATH || echo $i; done
libapr-1.so.0.4.5
libct.so.4.0.0
libsqlite3.so.0.8.6
libsybdb.so.5.0.0
Functions: echo file grep readelf
Check if the files in current directory has the RPATH variable defined
Using gentoo prefix portage I got in a situation where some packages did not contain the needed RPATH variable. This command helped me to find out which ones I should recompile
bash --rcfile /a/special/bashrc
Launch an interactive shell with special aliases and functions.
awk -F: '{print $3}' /etc/passwd | sort |uniq -d
user@host:/etc# awk -F: '{print $3}' /etc/passwd | sort |uniq -d
203
user@host:/etc#
Find duplicate UID in /etc/passwd
sudo echo 1 > /proc/acpi/asus/camera
Switch on eeepc camera
In some applications on eeepc xandros 7, default OS, video ccamera is not available untill you enter this command
netstat -tap | grep mysql
Find out if MySQL is up and listening on Linux
infile=$1 for i in $(cat $infile) do echo $i | tr "," "\n" | sort -n | tr "\n" "," | sed "s/,$//" echo done
Sort values arranged in rows, like:
x3, x5, x1, x4, x7, x2, x6
x11, x13, x14, x8, x10, x12, x9
... ... ... ... ... ... ...
After executing the script, values will be horizontally sorted:
x1, x2, x3, x4, x5, x6, x7
x8, x9, x10, x11, x12, x13, x14
where x1, x2, ..., xn are integers
Each row can have n integers and
x1 < x2 < x3, ..., < x7
x8 < x9 < x10, ..., < x14
.. .. .. ..
After executing the script, each row will be sorted in ascending order.
Functions: cat echo sed sort tr
Sorting by rows
Save the script as: sort_file
Usage: sort_file < sort_me.csv > out_file.csv
This script was originally posted by Admiral Beotch in LinuxQuestions.org on the Linux-Software forum.
I modified this script to make it more portable.
pidstat -C "ffmpeg" -u
Command to display how much resource is taken by cpu and which core is taking
echo "(Something like http://foo.com/blah_blah)" | grep -oP "\b(([\w-]+://?|www[.])[^\s()<>]+(?:\([\w\d]+\)|([^[:punct:]\s]|/)))"
http://foo.com/blah_blah
From http://daringfireball.net/2009/11/liberal_regex_for_matching_urls
Thought it would be useful to commandlinefuers.
grep -Eo '"entries":\[{"url":"[^"]*"' "$HOME/.mozilla/firefox/*.default/sessionstore.js" | sed 's/^.*:"//; s/"$//'
while true; do curl -s http://whatthecommit.com | perl -p0e '($_)=m{<p>(.+?)</p>}s' | cowsay; sleep 2; done
_______________________
< omg what have I done? >
-----------------------
Functions: perl sleep
I used curl instead of lynx.
for i in {0..3}; do cpufreq-set -c $i -g performance; done
Sets performance CPU governer of all cores of a 4-core CPU.
whichpkg() { rpm -qf "$@"; }
~$ whichpkg /bin/sort
coreutils-8.10-2.fc15.x86_64
Find the package a command belongs to on rpm-based distros
Find the package a file belongs to on an rpm-based distro.
@bt:~$ sudo /opt/nessus/sbin/nessusd
Startup Nessus and initialize plugins on backtrack5
Starts the Nessus daemon, downloads and processes the plugins.
perl -p -i -e 's/.*\n//g if $.==2' ~/.ssh/known_hosts
Easily removes line #2 in ~/.ssh/known_hosts.
mencoder "mf://frame_*.bmp" -mf w=720:h=480:fps=30:type=bmp -ovc lavc -lavcopts vcodec=mpeg4 -o number_video.mp4
Convert a batch of images to a Video
Converts the batch of images to video.
*mencoder* required.
curl -s "http://search.yahooapis.com/WebSearchService/V1/spellingSuggestion?appid=YahooDemo&query=mozmbque"|sed -n -e 's/.*<Result>\(.*\)<\/Result>.*/\1/p'
mozambique
Spelling Suggestion
Spelling Suggestion using Yahoo! API
ps -o user,%cpu,%mem,command
$ ps -o user,%cpu,%mem,command
USER %CPU %MEM COMMAND
fser 0.0 0.1 bash
fser 0.0 0.0 ps -o user,%cpu,%mem,command
Using ps options rather than filtering.
cat myfile.mp3 | ssh user@remotemachine "mplayer -cache 8912 -"
Play local mp3 file on remote machine's speakers
Play local mp3 file on remote machine's speakers through ssh
find /usr/include/ -name '*.[c|h]pp' -o -name '*.[ch]' -print0 | xargs -0 wc -l | tail -1
Counting the source code's line numbers C/C++ Java
ls -t | head
$ ls -t | head
distroversions.txt
craigslist.txt
sql-bench
Bonnie.4539
dental.txt
vulnkb_v2.xml
error.log
asdf.txt
Show last changed files in a directory
This will quickly display files last changed in a directory, with the newest on top.
‹ First < 208 209 210 211 212 > Last ›
while true; do date; sleep 1; done
$ while true; do date; sleep 1; done
Mon Mar 23 15:42:52 PDT 2009
Mon Mar 23 15:42:53 PDT 2009
Mon Mar 23 15:42:54 PDT 2009
Mon Mar 23 15:42:55 PDT 2009
Mon Mar 23 15:42:56 PDT 2009
Handy if all you have is a console session or tty.
ack -ai 'searchterm'
echo "pretty realistic virtual typing" | randtype -m 4
this also generates errors (change 4 to higher number for more mistakes)
grep -ZlRr -e BAD_SCRIPT_LINE * |xargs -0 sed -i 's/BAD_SCRIPT_LINE//g'
remove script from infected html files
recursive find and replace. important stuff are grep -Z and zargs -0 which add zero byte after file name so sed can work even with file names with spaces.
find ~ -name "*.ttf" -exec cp {} /usr/share/fonts/truetype \; & fc-cache -f
Functions: cp fc-cache find
Search and install true type fonts under user home directory
1) Find true type fonts;
2) Copy them to /usr/share/fonts/truetype;
3) Reload font information.
function google() { xdg-open "http://www.google.com/#sclient=psy&q=$1"; }
search google from command line
google "command line fu"
if curl -s -I -H "Accept-Encoding: gzip,deflate" http://example.com/ | grep 'Content-Encoding: gzip' >/dev/null 2>&1 ; then echo Yes; else echo No;fi
wiki() { local IFS=_; dig +short txt "${*^}".wp.dg.cx; }
rany:~$ wiki richard stallman
rany:~$ wiki bourne again shell
"Bash is a free software Unix shell written for the GNU Project. Its name is an acronym which stands for Bourne-again shell. The name is a pun on the name of the Bourne shell (sh), an early and important Unix shell written by Stephen Bourne and distributed" " with Version 7 Unix circa 1978, and the concept of being \"born again\". Bash was created in 1987 by Brian Fox... http://a.vu/w:Bash"
Query wikipedia over DNS
Flush DNS cache on OS X 10.5 Leopard
cat /dev/urandom|awk 'BEGIN{"tput cuu1" | getline CursorUp; "tput clear" | getline Clear; printf Clear}{num+=1;printf CursorUp; print num}'
13164
Functions: awk cat printf
Watch number of lines being processed on a clear screen
awk can clear the screen while displaying output. This is a handy way of seeing how many lines a tail -f has hit or see how many files find has found. On solaris, you may have to use 'nawk' and your machine needs 'tput'
get the IP connected to the server (usefull to detect IP that should be blocked)
dirname `pwd`
Functions: dirname
Get parent directory path
find . -exec grep -q '<?php' {} /dev/null \; -ls
find php files even without extension
Find all php files in a directory and sub-directories even if they don't have an extension.
to limit to current directory use
find . -maxdepth 1 -exec grep -q '<?php' {} /dev/null \; -ls
for command line scripts, could also use
find . -exec grep -q '#!/usr/bin/php' {} /dev/null \; -ls
this would also work for bash scripts
find . -exec grep -q '#!/bin/bash' {} /dev/null \; -ls
find . -iregex ".+\.\(c\|cpp\|h\)" | xargs -I{} perl -e "system(\"iconv -f SHIFT_JIS -t UTF-8 {} > temp; mv temp {} \");" ;
Converts Character Set of Files in a Folder
for i in $(pgrep -v -u root);do kill -9 $i;done
Kill all processes that don't belong to root/force logoff
explanation:
grep -- displays process ids
-v -- negates the matching, displays all but what is specified in the other options
-u -- specifies the user to display, or in this case negate
The process loops through all PIDs that are found by pgrep, then orders a forced kill to the processes in numerical order, effectively killing the parent processes first including the shells in use which will force the users to logout.
Tested on Slackware Linux 12.2 and Slackware-current
s="124890";for i in $(seq 0 1 $((${#s}-1))); do arr[$i]=${s:$i:1}; done
convert string to array
find / -type f -size +100M -exec du {} \; | sort -n | tail -10 | cut -f 2
Functions: cut du find sort tail
function where(){ COUNT=0; while [ `where_arg $1~$COUNT | wc -w` == 0 ]; do let COUNT=COUNT+1; done; echo "$1 is ahead of "; where_arg $1~$COUNT; echo "by $COUNT commits";};function where_arg(){ git log $@ --decorate -1 | head -n1 | cut -d ' ' -f3- ;}
1178c5950d321a8c5cd8294cd67535157e296554 is ahead of
(project16/taskbranch-514)
by 3 commits
Functions: cut echo head wc
telling you from where your commit come from
where COMMIT
for instance:
where 1178c5950d321a8c5cd8294cd67535157e296554
where HEAD~5
find /usr/lib/python* -regextype posix-extended ! \( -type f -regex '.*.(pyc|pyo)' -prune -o -print \) | qfile -o -f -
Check for orphaned python files
tail -f LOGFILE | perl -ne '`say "$_"`;'
speak a chat log file while it's running
say only processes a complete file, at eof, so following a file isn't possible. Quick and dirty perl oneliner to feed each line from the tail -f to say. Yes, expensive to lauch a new process each line.
This little ditty was prompted by a discussion on how horrible it is to use VoiceOver on ncurses programs such as irssi.
grep -Ilr "<?php" .
./CustomFields/add-avatars.php
./examples/example-widget.php
./examples/multiwidget.php
./examples/Recent_Comments.php
./examples/Recent_Posts.php
needs grep what supports '--recursive'
alias path="/usr/bin/perl -e 'use Cwd; foreach my \$file (@ARGV) {print Cwd::abs_path(\$file) .\"\n\" if(-e \$file);}'"
path some_file.txt
/home/espider/some_directory/some_file.txt
Creates a 'path' command that always prints the full path to any file
The command creates an alias called 'path', so it's useful to add it to your .profile or .bash_profile. The path command then prints the full path of any file, directory, or list of files given. Soft links will be resolved to their true location. This is especially useful if you use scp often to copy files across systems. Now rather then using pwd to get a directory, and then doing a separate cut and paste to get a file's name, you can just type 'path file' and get the full path in one operation.
strings libc-2.2.5.so | grep stat.h
look for a header reference in a shared library
rpm -qlp <package.rpm>
check rpm pkg content w/o installation
allows to check inside rpm file w/o installing it
gconftool-2 --set /apps/nautilus/preferences/show_desktop --type bool 0
What you're really trying to do is make all the icons go away, right? It's not that hard, guys. Saves a lot of heart ache and hard drive activity to just tell Gnome to not display the icons.
‹ First < 209 210 211 212 213 > Last ›
find /path/to/dir -type f |sed 's/^.*\.//' |sort -f |uniq -i
list all file-types (case-insensitive extensions) including subdirectories
seq 20 | awk 'ORS=NR%5?FS:RS'
1 2 3 4 5
6 7 8 9 10
11 12 13 14 15
16 17 18 19 20
join every five lines
seq 20 | awk '{line=line sep $0; sep=" "} !(NR%5){print line; line=sep=""}'
rm_cache() { rm -f $HOME/.mozilla/firefox/<profile>/Cache/* }; alias rmcache='rm_cache'
Functions: alias rm
Clears Firefox` cache without clicking around
ldapmodify -Y "dn:uid=rob,dc=example.com" -g -R -J 2.16.840.1.113730.3.4.16 ...
modify (mozldap) with proxy authentication and no other controls
grep -E '^(cn|mail):' file.ldif | sed -e 's/^[a-z]*: //'
Extract names and email addresses from LDIF files
sqlite3 .mozilla/firefox/private/places.sqlite "update moz_places set favicon_id=null where favicon_id = (select p.favicon_id from moz_bookmarks b join moz_places p on b.fk = p.id where b.title = 'Broken');"
clear stale favicons in firefox
awk '{x+=$2; y+=$3} NR%5==0{print x/5,y/5; x=y=0}' file.txt
group every five lines
mysqldump | sed -e 's/^) ENGINE=MyISAM/) ENGINE=InnoDB/'
mysql: Convert MyISAM tables to InnoDB via mysqldump
Textually convert the storage engine of MyISAM tables to InnoDB. This solution requires dumping of the database, transforming, and importing onto another server.
cat /proc/cpuinfo
cpuinfo
ldconfig -p | grep <somenewlib.so>
Functions: grep ldconfig
List shared libraries recognized by the system
Allows to check if shared library could be dynamically loaded
s=124890; array=($(echo $s | sed 's/./& /g')); echo ${array[@]}; echo ${!array[@]}
1 2 4 8 9 0
0 1 2 3 4 5
Convert string to array using echo and sed =)
ifconfig eth0 | grep -o "inet [^ ]*" | cut -d: -f2
ffmpeg -i "inputFile.avi" -f psp -r 29.97 -b 512k -ar 24000 -ab 64k -s 368x208 M4V00002.MP4
Convert movie to psp format
lynx -dump http://www.domain.com | awk '/http/{print $2}' | egrep "^https{0,1}"
sed -n "/^USE \`employees\`/,/^USE \`/p"
MySQL: Slice out a specific database (assumes existence of the USE statement) from mysqldump output
The 'USE' statement only appears in mysqldump's output if multiple databases are exported, or --databases is specified.
This command filters only those statements relating to a specific database ('employees' in the example).
chflags -R nouchg ./
make a samba shared folder writable, when doing an svn commit on OSX
otherwise you get this error message:
svn: Can't move '.svn/tmp/entries' to '.svn/entries': Operation not permitted
SUM=0; for FILESIZE in `find /tmp -type f -iname \*pdf -exec du -b {} \; 2>/dev/null | cut -f1` ; do (( SUM += $FILESIZE )) ; done ; echo "sum=$SUM"
sum=16173037
Functions: cut du echo
This example summarize size of all pdf files in /tmp directory and its subdirectories (in bytes).
Replace "/tmp" with directory path of your choice and "\*pdf" or even "-iname \*pdf" with your own pattern to match specific type of files. You can replace also parameter for du to count kilo or megabytes, but because of du rounding the sum will not be correct (especially with lot of small files and megabytes counting).
In some cases you could probably use sth like this:
du -cb `find /tmp -type f -iname \*pdf`|tail -n 1
But be aware that this second command CANNOT count files with spaces in their names and it will cheat you, if there are some files matching the pattern that you don't have rights to read. The first oneliner is resistant to such problems (it will not count sizes of files which you cant read but will give you correct sum of rest of them).
ffmpeg -i movie.mpg -vhook '/usr/lib/vhook/watermark.so -f overlay.png -m 1 -t 222222' -an mm.flv
add overlay png image to video as logo...........
function mg(){ man ${1} | egrep ${2} | more; }
e.g. mg mplayer playlist
mplayer [options] [file|URL|playlist|-]
Functions: egrep man
Fewer keystrokes to search man page of command
Quicker way to search man pages of command for key word
sudo -b xterm
"The -b (background) option tells sudo to run the given command in the background." -- after it asks you for the password in the foreground.
Play Star Wars Episode IV in your terminal ;)
fsutil hardlink creat new_file exits_file
hard link file for Windows
svn_find () { local a=$1; shift; find $a -not \( -name .svn -prune \) $*; }
bash function for convenient 'find' in subversion working directories
you can use svn_find just like the regular find command, except that subdirectories named .svn will be ignored.
example: svn_find . -mtime -1 -size +200k -ls
-> all files modified within last day and bigger then 200 KiB, but ignores subdirectories named .svn
cd /this/directory; for f in *; do ln -s `pwd`/$f /that/directory; done
Functions: cd ln
Link all the files in this directory to that directory
I find this handy for linking all the bin files in a package to /usr/bin or all the man files to /usr/share/man. You can replace * with */* to operate on all the files in subdirectories.
( while read File; do mogrify -resize 1024 -quality 96 $File; done ) < filelist
Change size of lots of image files. File names are read from a text file.
Imagemagick library is used. If image format is not JPEG, the "quality" option should not be issued.
‹ First < 210 211 212 213 214 > Last ›
while read line; do echo -e "$line@mail.com"; done < list.txt
$ while read line; do echo -e "$line@mail.com"; done < list.txt
john@mail.com
mark@mail.com
white@mail.com
lion@mail.com
robert@mail.com
@mail.com by adding the line in list.txt
Add @mail.com each line of a list
START=20; END=50 echo $(($START+(`od -An -N2 -i /dev/random`)%($END-$START+1)))
Generate a random number in a range
This commands lets you generate a random number between the range [$START; $END].
aptitude remove $(deborphan)
Remove unused libs/packages
deborphan(1) must be installed.
mysqlcheck -op -u<user> <db>
mysql.help_keyword OK
mysql.help_relation OK
mysql.help_topic OK
mysql.host Table is already up to date
-o : optimize
-p : asks for password
-u : user to use for authentication
curl http://www.discogs.com/search?q=724349691704 2> /dev/null | grep \/release\/ | head -2 | tail -1 | sed -e 's/^<div>.*>\(.*\)<\/a><\/div>/\1/'
Changed wget to curl and it doesn't create a file anymore.
mysqldump | sed -n "/^USE \`employees\`/,/^USE \`/p" | sed -n "/^-- Table structure for table \`departments\`/,/^-- Table structure for table/p"
MySQL: Slice out a specific table from a specific database (assumes existence of the USE statement) from output of mysqldump
Only filter the statements to create and deploy a specifc table from a specific database (`departments`.`employees` in the example)
for server in `brightbox-servers list |grep active|awk '{ print $1}'`;do brightbox-servers destroy $server;done
Destroying server srv-XXXX1
Destroying server srv-XXXX2
You need to have Brightbox Cloud CLI tools installed
defaults write /Library/Preferences/com.apple.NetworkAuthorization UseShortName -bool YES
use the short username by default for network authentication
This command will use the short username (ie: bsmith) instead of the full (or long) name (ie: Bob Smith), by default in the network authentication dialog, ie: when connecting to servers. Resulting in one less step/time saved.
Simply change the boolean value to "NO" (ie: "... -bool NO") to revert to the system's default behavior.
defaults write com.apple.desktopservices DSDontWriteNetworkStores true
Stop Mac OSX from creating .DS_Store files when interacting with a remote file server with the Finder
echo -n "String to MD5" | md5sum | cut -b-32
Functions: cut echo md5sum
Generate MD5 of string and output only the hash checksum
du --max-depth=1 -B M |sort -rn
1899M .
889M ./corner
226M ./Downloads
142M ./.local
87M ./.mozilla
58M ./.cache
38M ./.kde
24M ./ogm
18M ./.config
simple du command to give size of next level of subfolder in MB
If you're only using -m or -k, you will need to remember they are either in Megabyte or kilobyte forms. So by using -B, it gives you the unit of the size measurement, which helps you from reading the result faster. You can try with -B K as well.
mysqldump --opt -uUSERNAME -pPASSWORD -h mysql.host.com database > ~/filename.sql
cat my.cnf | sed '/^#/d' | sed '/^$/d' | sed -e 's/[ \t]\+//g'
MySQL: Strip a my.cnf file from comments, remove blank lines, normalize spaces:
"normalize" a my.cnf file.
for ip in `brightbox-cloudips list |grep unmapped|awk '{ print $1}'`;do brightbox-cloudips destroy $ip;done
pgrep xterm
Find the process ID of such program:
pgrep is an useful tool which looks through the currently running processes and lists the process IDs which matches the selection criteria to stdout. pkill can also be used with pgrep to send a kill signal to the program.
find / -nouser -o -nogroup -print
list files not owned by any user or group
tested in csh on solaris.
x2vnc {-west|-east|-north|-south} computer-ip:display-number
Emulate a dual-screen using vnc
This command use vnc to connect to another computer and emulate an dual-screen enviroment.
Example of use:
x2vnc -west 192.168.0.100:0
After this, if vnc server needs an password, will be prompt in the shell.
p.s.: sorry my english
find . -name file.txt | xargs -e grep "token" -o | wc -l
Count occurrences of a word/token in a file
xmodmap -e 'keycode 10 = 1 plus brokenbar exclamdown brokenbar exclamdown' ; xmodmap -e 'keycode 16 = 7 slash bar seveneighths bar seveneighths'
reassign pipe key from AltGr-1 to AltGr-7 in X11
alias histdel='history -d $((HISTCMD-2)) && history -d $((HISTCMD-1))'
$ ssh root@www1.example.co m
ssh: Could not resolve hostname www1.example.co: nodename nor servname provided, or not known
$ hackm3!
# (Oh crap. I just typed the password on the commandline)
$ history |tail
504 ssh root@www1.example.co m
505 hackm3!
# Now it's clear.
$ histdel; histdel
503 ssh root@www1.example.co m
504 history |tail
I rarely need this, but I have a hard time remembering the command when I need it.
Admit it. This has happened to you. Yes this is bad, and you better clean up now.
Borrowed from http://thoughtsbyclayg.blogspot.com/2008/02/how-to-delete-last-command-from-bash.html
Convert encoding of a file
cd /usr/src ; wget http://www.rarlab.com/rar/unrarsrc-4.0.2.tar.gz ; tar xvfz unrarsrc-4.0.2.tar.gz ; cd unrar ; ln -s makefile.unix Makefile ; make clean ; make ; make install
Functions: cd ln make tar wget
Install unrar on Linux box from sources
sed -i "$(grep -nm 1 match file|cut -f1 -d:)d" file
Remove the first line containing 'match' from file
cat my.sandbox.cnf | awk -F "=" 'NF < 2 {print} sub("=", "=~placeholder~=") {print}' | awk -F "=~placeholder~=" 'NF < 2 {gsub("-", "_", $0); print} NF==2 {gsub("-", "_", $1); print $1 "=" $2}'
MySQL: normalize parameter names on my.cnf configuration file
Multi-word parameters in my.cnf can be written with either hyphens or underscores. innodb_file_per_table is the same as innodb-file-per-table, as well as innodb_file-per_table. The script normalizes the parameter names to using underscores only, keeping from changing values (e.g. ?mysql-bin? parameter value should not change).
diff -ru originDir updateDir > result.patch
Removes an extra character and space.
‹ First < 211 212 213 214 215 > Last ›
wmctrl -o 100,0
Switch workspace
For a demo try
wmctrl -o 100,0; sleep 3; wmctrl -o 1500,0; sleep 3; wmctrl -o 3000,0; sleep 3; wmctrl -o 4500,0;
Actually
wmctrl -o <width x Number>,0;
to switch to that workspace
find . -size 0 -exec rm '{}' \;
cat /dev/urandom | tr -dc 'a-zA-Z0-9' | fold -w 10 | sed 1q
15fIrGab5C
Functions: cat fold sed tr
generate password
find . -maxdepth 1 -name "*.zip" -exec unzip -tqq {} \;
unzip: cannot find zipfile directory in one of ./somefile.sql.zip
Check if zip files from current directory are good
if you remove maxdepth, then all the folders will be searched and the status of zip file will be displayed only if it is corrupt.
gs -dNOPAUSE -sDEVICE=pdfwrite -sOUTPUTFILE=output.pdf -dBATCH first.pdf second.pdf
grep -E '<DT><A|<DT><H3' bookmarks.html | sed 's/<DT>//' | sed '/Bookmarks bar/d' | sed 's/ ADD_DATE=\".*\"//g' | sed 's/^[ \t]*//' | tr '<A HREF' '<a href'
<h3>search engines</h3>
<a href="http://google.com/">google search engine</a>
convert chrome html export to folders, links and descriptions
chrome only lets you export in html format, with a lot of table junk, this command will just export the titles of the links and the links without all that extra junk
system_profiler SPApplicationsDataType | grep -A3 -B4 "Kind: PowerPC"
No final count, but clean and simple output.
whichpath() { local -A path; local c p; for c; do p=$(type -P "$c"); p=${p%/*}; path[${p:-/}]=1; done; local IFS=:; printf '%s\n' "${!path[*]}"; }
rany:~$ whichpath md5sum cat ls nc sat
/bin:/home/rany/bin:/usr/bin
Functions: printf type
Which PATH variable should I use for this scirpt?
I find it useful when I want to add another crontab entry and I need to specify the appropriate PATH.
I give ''whichpath'' a list of programs that I use inside my script and it gives me the PATH I need to use for this script.
''whichpath'' uses associative array, therefore you should have Bash v4 in order to run it.
See sample output.
xdotool getmouselocation
Get mouse location (X,Y coordinates)
cp path/filename{,-$(date +%Y-%m-%d)}
$ cp test.txt{,-$(date +%Y-%m-%d)}
$ ls -l test.txt*
-rw-rw-r-- 1 user group 0 Aug 6 13:40 test.txt
-rw-rw-r-- 1 user group 0 Aug 6 13:41 test.txt-2009-08-06
Create a backup of the file.
It will create a backup of the filename. The advantage is that if you list the folder the backups will be sorted by date. The command works on any unix in bash.
> [filename].txt
empties a file...
--- fir3net.com ---
git log --name-only | less
Find out what files are changed or added in a git repository.
sed -i s/split\(/explode\(/ whatever.php
replace deprecated php-function split in php files
only for non-regexp-split - else use preg_split instead.
pcregrep --color -M -N CRLF "owa_pattern\.\w+\W*\([^\)]*\)" source.sql
Source multiline grep with pcregrep
grep multiline in Perl regexp syntax with pcregrep
pcregrep -r --exclude_dir='.svn' --include='.*jsp$' -A 2 -B 2 --color "pHtmlHome" .
./Titoli/titoli.CartaCredito.jsp-<title>Gestione pagamenti
./Titoli/titoli.CartaCredito.jsp-
./Titoli/titoli.CartaCredito.jsp:
./Titoli/titoli.CartaCredito.jsp-
./Titoli/titoli.CartaCredito.jsp-<%@ page language="java" %>
./Titoli/titoli.CartaCredito.jsp-<%@ page import="com.base.*" %>
./Titoli/titoli.CartaCredito.jsp-
./Titoli/titoli.CartaCredito.jsp:
./Titoli/titoli.CCPostale.jsp-Gestione pagamenti / C/C Postale
./Titoli/titoli.CCPostale.jsp-
./Titoli/titoli.CCPostale.jsp:
./Titoli/titoli.CCPostale.jsp-
./Titoli/titoli.CCPostale.jsp-<%@ page language="java" %>
Recursive source regexp search with pcregrep
range context (-A -B) search, with exclusion of vcs directories
{ command1 args1 ; command2 args2 ; ... }
redirecting stdout of multiple commands
{ ... } vs ( ... ) reduces the process count, I believe.
Typically, I use this logic to redirect a series of commands to a pipe -- { command1 args1 ; command2 args2}|less -- or file -- { command1 args1 ; command2 args2}>foo -- or to spawn the series as a background process -- { ... } & .
!
$ history | grep 'ipt'
2 iptables -L -n -v -t nat
$ !2 # will execute the iptables command
Execute the command given by history event number
You can find a command's history event number via the `history` command.
You can also put the history event number in your prompt: \! for bash, or %h for zsh.
Finally, I would like to point out that by "number", I mean POSITIVE INTEGER. Not, say, a letter, such as 'm'. Examples:
!1
!975
ps -ef | grep [f]oo | awk '{print $2}' | xargs kill -9
kill all foo process
Kill all processes with foo in them. Similar to pkill but more complete and also works when there is no pkill command.
Works on almost every Linux/Unix platform I have tried.
export LANG=C; grep string longBigFile.log
Functions: export grep
Fast grepping (avoiding UTF overhead)
greps using only ascii, skipping the overhead of matching UTF chars.
Some stats:
$ export LANG=C; time grep -c Quit /var/log/mysqld.log
user 0m0.112s
sys 0m0.079s
$ export LANG=en_US.UTF-8; time grep -c Quit /var/log/mysqld.log
real 0m13.462s
user 0m9.485s
sys 0m3.977s
Try strace-ing grep with and without LANG=C
gnu@robby:/tmp$ ls
FlashRvagFf plugtmp
FlashXzXntM pulse-0TTrCRtslQIP
keyring-kuxf9m pulse-kBvjtHC3bUl5
orbit-gnu ssh-MlVNQs3733
gnu@robby:/tmp$ mencoder FlashRvagFf -ovc lavc -oac mp3lame -o output.avi
success: format: 0 data: 0x0 - 0x12a88ad
ISO: File Type Major Brand: ISO/IEC 14496-1 (MPEG-4 system) v2
Quicktime/MOV file format detected.
Warning! pts=14075904 length=14076810
[mov] Audio stream found, -aid 0
Warning! pts=28728000 length=28727924
[mov] Video stream found, -vid 1
VIDEO: [avc1] 512x384 24bpp 25.000 fps 0.0 kbps ( 0.0 kbyte/s)
[V] filefmt:7 fourcc:0x31637661 size:512x384 fps:25.00 ftime:=0.0400
AUDIO: 44100 Hz, 2 ch, s16le, 88.3 kbit/6.25% (ratio: 11032->176400)
Selected audio codec: [faad] afm: faad (FAAD AAC (MPEG-2/MPEG-4 Audio) decoder)
VDec: vo config request - 512 x 384 (preferred colorspace: Planar YV12)
videocodec: libavcodec (512x384 fourcc=34504d46 [FMP4])
Video stream: 540.588 kbit/s (67573 B/s) size: 21555944 bytes 319.000 secs 7980 frames
Audio stream: 276.788 kbit/s (34598 B/s) size: 11034460 bytes 318.929 secs
convert flv into avi file and mp3 sound
ifconfig -l | xargs -n1 ipconfig getifaddr 2> /dev/null
Functions: ifconfig xargs
echo -n "String to MD5" | md5sum | sed -e 's/../& /g' -e 's/ -//'
Same result with simpler regular expression..
mail -H | grep '^.U' | wc -l
Functions: grep mail wc
Count new mail
Counts the number of new emails in the post office (or wherever mail is set up to check).
cvs up -r1.23 -p main.cpp | vim -
Functions: cvs vim
read old reversion of file
echo 'hello world'
print an 'hello world'
‹ First < 212 213 214 215 216 > Last ›
timeDNS () { { for x in "${local_DNS}" "208.67.222.222" "208.67.220.220" "198.153.192.1" "198.153.194.1" "156.154.70.1" "156.154.71.1" "8.8.8.8" "8.8.4.4"; do ({ echo -n "$x "; dig @"$x" "$*"|grep Query ; }|sponge &) done ; } | sort -n -k5 ; }
$ timeDNS commandlinefu.com
192.168.0.1 ;; Query time: 2 msec
208.67.222.222 ;; Query time: 13 msec
198.153.192.1 ;; Query time: 17 msec
208.67.220.220 ;; Query time: 17 msec
156.154.71.1 ;; Query time: 18 msec
8.8.8.8 ;; Query time: 20 msec
156.154.70.1 ;; Query time: 22 msec
8.8.4.4 ;; Query time: 22 msec
198.153.194.1 ;; Query time: 27 msec
Functions: dig echo grep sort
a function to find the fastest free DNS server
Evoke from the command like as:
timeDNS commandlinefu.com
This isn't too terribly practical, but it is a good code example of using subshells to run the queries in parallel and the use of an "anonymous function" (a/k/a "inline group") to group i/o.
I'm assuming you have already defined your local DNS cache as ${local_DNS}, (here, it's 192.168.0.1).
You do need to install `moreutils` to get `sponge`.
If you're willing to wait, a slower version w/o sponge, (and w/o sorting), is this:
svn log -v -r{2009-11-1}:HEAD | awk '/^r[0-9]+ / {user=$3} /./{if (user=="george") {print}}' | grep -E "^ M|^ G|^ A|^ D|^ C|^ U" | awk '{print $2}' | sort | uniq
/svnproject/somedir/childdir/bfile.txt
/svnproject/somedir/childdir2/afile1.txt
/svnproject/somedir2/childdir/zfile.txt
/svnproject/somedir/childdir3/yfile.txt
/svnproject/somedir5/childdir/xfile.txt
Functions: awk grep sort
svn log -v --> takes log of all
Filter1
--------
-r {from}{to} --> gives from and to revision
Filter2
awk of line 'r'with numbers
Assign user=3rd column [ie; username]
Filter3
if username = George
print details
Filter4
Print lines starts with M/U/G/C/A/D
[* A Added * D Deleted * U Updated * G Merged * C Conflicted]
Filter5
sort all files
Filter6
-------
Print only uniq file's name alone.
for HOSTTOREMOVE in $(dig +short host.domain.tld); do ssh-keygen -qR $HOSTTOREMOVE; done
/home/USER/.ssh/known_hosts updated.
Original contents retained as /home/USER/.ssh/known_hosts.old
Functions: dig ssh-keygen
Works for multiple hosts (such as www.google.com) and/or wrong hosts.
locate -e somefile | xargs ls -l
laptop:~# locate -e freetype.so | xargs ls -l
-rw-r--r-- 1 root root 483556 2009-06-01 14:50 /usr/lib32/libfreetype.so.6.3.20
-rw-r--r-- 1 root root 551872 2009-06-01 14:40 /usr/lib/libfreetype.so.6.3.20
locate a filename, make sure it exists and display it with full details
use the locate command to find files on the system and verify they exist (-e) then display each one in full details.
curl -s http://icanhazip.com/
for code in $(find . -type f -name '*.p[ml]'); do perl -c "$code"; done
./foo.pl syntax OK
./bar/Baz.pm syntax OK
Check syntax of all Perl modules or scripts underneath the current directory
Finds all *.p[ml]-files and runs a perl -c on them, checking whether Perl thinks they are syntactically correct
find . -iname \*${MYVAR}\* -print
Use a variable in a find command. Useful in scripting.
You define your variable MYVAR with the desired search pattern:
MYVAR=
...which can then be searched with the find command.
This is useful if you in a script, where you want the arguments to be fed into the find command.
The provided search is case insensitive (-iname) and will find all files and directories with the pattern MYVAR (not exact matches). This may go without saying, but if you want exact matches remove the \* and if you want case sensitive, use the -name argument.
curl --silent http://www.dudalibre.com/gnulinuxcounter?lang=en | grep users | head -2 | tail -1 | sed 's/.*//g' | sed 's/<\/strong>.*//g'
Functions: grep head sed tail users
Get the amount of users currently registered at the DudaLibre.com Linux Counter.
echo | ifconfig | grep HWaddr
Functions: echo grep ifconfig
printf "g/^/m0\nw\nq"|ed $FILE
Functions: ed printf
also works in vim
ssh-keygen -C hello@world
Put at the end of the rsa public key an comment(default value is the hostname)
Now at the end of the rsa.pub file, there is our comment like=
".................peXeuE0ytJgpQcXeR5aHlfLa8dAt0obasd hello@world"
package-cleanup --leaves --all
Setting up yum
Loaded plugins: fastestmirror, refresh-packagekit
Loading mirror speeds from cached hostfile
xorg-x11-drv-siliconmotion-1.6.0-1.fc9.x86_64
xorg-x11-drv-fpit-1.2.0-1.fc9.x86_64
nss_db-2.2-43.fc10.x86_64
List all packages with no dependencies (yum based system)
This command lists all packages in a yum based system that no other packages depend on. Hence, these packages are good candidates for removal. It's a great command for cleaning up a yum based distribution after installation.
egrep 'string1|string2' file
grep or
search file for string1 or string2
#!/bin/sh #du.sh i=`hostname -i` df -h > /tmp/space.txt echo "server $i " >> /tmp/space.txt uuencode /tmp/space.txt space.txt | mail -s "HDD usage $i" email@email.com
Functions: df echo mail uuencode
Send Disk usage via email
source .bashrc
root@ubuserver:~# source .bashrc
root@ubuserver:~#
reload config
reload a configuration from .bashrc file
apt-cache search pidgin* | awk '{print$ 1}' | tr '\n' ' ' | xargs aptitude -y install
Functions: apt awk tr xargs
Install evertything with the prefix pidgin or wathever
Command to install everything on a debian based system with the prefix you indicate.
curl --verbose -d "hello=world" http://mydomain.com
Make a HTTP request using curl with POST method
$ wget --mirror -p --convert-links -P ./
?mirror : turn on options suitable for mirroring.
-p : download all files that are necessary to properly display a given HTML page.
?convert-links : after the download, convert the links in document for local viewing.
-P ./LOCAL-DIR : save all the files and directories to the specified directory.
dpkg -c deb_package
dpkg -c google-chrome-stable_current_i386.deb
drwx------ root/root 0 2011-07-11 23:31 ./
drwxr-xr-x root/root 0 2011-07-11 23:31 ./etc/
drwxr-xr-x root/root 0 2011-07-11 23:32 ./etc/cron.daily/
drwxr-xr-x root/root 0 2011-07-11 23:31 ./usr/
drwxr-xr-x root/root 0 2011-07-11 23:32 ./usr/bin/
drwxr-xr-x root/root 0 2011-07-11 23:31 ./usr/share/
drwxr-xr-x root/root 0 2011-07-11 23:32 ./usr/share/menu/
List contents of a deb package
for i in $(locate your_search_phrase); do dirname $i; done | sort | uniq
Functions: dirname locate sort
search for files or directories, then show a sorted list of just the unique directories where the matches occur
Ever use 'locate' to find a common phrase in a filename or directory name? Often you'll get a huge list of matches, many of which are redundant, and typically the results are not sorted. This command will 'locate' your search phrase, then show you a sorted list of just the relevant directories, with no duplications. So, for example, maybe you have installed several versions of the java jre and you want to track down every directory where files matching "java" might exist. Well, a 'locate java' is likely to return a huge list with many repeated directories since many files in one directory could contain the phrase "java". This command will whittle down the results to a minimal list of unique directory names where your search phrase finds a match.
sudo snmptrap -m ALL -v 2c -c public trapserver "" UCD-DEMO-MIB::ucdDemoPublic SNMPv2-MIB::sysLocation.0 s "Just here"
Send SNMP traps
/sbin/lspci (-v is verbose)
FINDING PCI DEVICES
tac $FILE
mkdir /tmp/dir1/{0..20}
make directory
Here was simple.
32K sub-dir1
32K sub-dir2
32K sub-dir3
17M sub-dir4
508K sub-dir5
Current sub-folders sizes
‹ First < 213 214 215 216 217 > Last ›
perl -lane 'print "$F[0]:$F[1]:$F[2]"' myfile
# perl -lane 'print "$F[3] $F[6] $F[2]"' myfile
this is perl
Rearrange words from a file
Consider this line :
random perl language this make possible is
is possible to rearrange words with $F perl variable and word index, starting from 0.
tune2fs -j /dev/sdX
Converts ext2 to ext3
unset MANPATH; manpath >/dev/null
# This creates the manpath from my PATH, after it parses man.conf
bash$ echo $PATH
/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/usr/X11/bin:/opt/local/bin:/opt/local/sbin:/Users/stefanl/bin:/our_company_utils/bin/
bash$ unset MANPATH; manpath
/usr/share/man:/usr/local/share/man:/usr/X11/man:/opt/local/share/man:/Users/user/man:/opt/local/man:/our_company_utils/man/
Functions: manpath unset
Find Man pages for everything in your $PATH
If I type 'man something', I want it to find the manpage in the same order as my PATH.
You can add something like this to your .bashrc
# Add my MacPorts, my personal utilities and my company utilities to my PATH.
export PATH=$PATH:/opt/local/bin:$HOME/bin:/our_company_utils/bin/
# Now set the manpath based on the PATH, after man(1) parses man.conf
# - No need to modify man.conf or manually modify MANPATH_MAP
# - Works on Linux, FreeBSD & Darwin, unlike /etc/manpaths.d/
# Must unset MANPATH first. MANPATH is set on some systems automatically (Mac),
# which causes manpath to ignore the values of PATH like /opt/local/bin (MacPorts).
# Also MANPATH may be deprecated. See "SEARCH PATH FOR MANUAL PAGES" in man(1)
unset MANPATH
# manpath acts differently on Solaris, FreeBSD, MacOSX & GNU. This works everywhere.
manpath >/dev/null
Note that MacOSX, FreeBSD & Linux have fancier ways to do some of this. (e.g. 'man --path' or 'man -q'), but this command is more universal and should work everywhere.
find "$1" -iname "*$2*"
This works fine too.
strace -e open zim 2>&1 1>/dev/null | fgrep ~ | fgrep -v "= -1" | cut -d'"' -f2
Functions: cut fgrep strace
Locate config files of the program
Locate config files of the program. May not be used for interactive programs like vim.
tcp(){ tcpdump -nUs0 -w- -iinterface $1|tcpdump -n${2-A}r- ;} usage: tcp '[primitives]' [X|XX]
unbuffered tcpdump
Sometimes the question comes up: How to get unbuffered tcpdump output into the next program in the pipe? i.e. if your OS forces you to wait for the buffer to fill before the next program sees any of the output
If you use -Uw- then you can't use -A (or -X or -XX) at the same time.
When the question comes up, I've never seen anyone suggest this simple solution: chaining 2 tcpdump instances.
find . -size 1400c -exec rm {} \;
remove files of a specific size
Removes all files in the current folder that are 1400 bytes in size.
sudo dd if=/dev/block/device bs=1MB | pv -s `sudo blockdev --getsize64 /dev/block/device' | gzip -9 > output.img.gz
Functions: dd gzip sudo
genRandomText() { a=( a b c d e f g h i j k l m n o p q r s t u v w x y z );f=0;for i in $(seq 1 $(($1-1))); do r=$(($RANDOM%26)); if [ "$f" -eq 1 -a $(($r%$i)) -eq 0 ]; then echo -n " ";f=0;continue; else f=1;fi;echo -n ${a[$r]};done;echo"";}
[bbbco ~]$ genRandomText 122
onzwxfeknlnvycuccvki dybtrqibdpgl aeclwkfpuxkohucy cqlmpbkwgcqesimxupdkqiymucljhitffb czegujyofidnxnvrkolhmudslpklbjnpmun
[bbbco ~]$ genRandomText 122 | wc -m
122
[bbbco ~]$ genRandomText 27
b bpglferrcsrtveiop umn nq
[bbbco ~]$ genRandomText 27 | wc -m
27
Generate Random Text based on Length
Ever need to get some text that is a specific number of characters long? Use this function to easily generate it! Doesn't look pretty, but sure does work for testing purposes!
for i in `seq -w 1600` ; do links -dump http://www.robsjokes.com/$i/index.html | sed '/Random Joke/,/Next Joke/!d' | sed '/^$/,/^$/!d' >> ~/temp/Rob.jokes ; echo '%' >> ~/temp/Rob.jokes ; done
fetch 1600 jokes from robsjokes.com into a single file, which is fortunable
svn add $(svn st|grep ^\?|cut -c2-)
This version makes uses of Bash shell expansion, so it might not work in all other shells.
find /DirectoryWhereMyMp3sAre/ -name *.mp3 | grep "andy" > ~/mylist
In the file mylist in your home directory
/DirectoryWhereMyMp3sAre/andy.mp3
/DirectoryWhereMyMp3sAre/andy2.mp3
/DirectoryWhereMyMp3sAre/sandy.mp3
/DirectoryWhereMyMp3sAre/kandy.mp3
This file can now be played with
mpg321 -@ ~/mylist
yum whatprovides /usr/lib/libXX1.so /usr/lib/libXX2.so | grep fc | sed 's/^\(.*\)-[0-9.]*-.*$/\1/' | sort | uniq | xargs yum -y install
Functions: fc grep sed sort uniq xargs
install package which provides some libraries in fedora
this command will install the packages which provides the libraries you need to link with, e.g. when you compile something needs opengl libraries:
gcc -o testgl testgl.c -lGLEW -lGL -lGLU -lglut
you can use `/usr/lib/libGLEW.so /usr/lib/libGL.so /usr/lib/libGLU.so /usr/lib/libglut.so'
find . -maxdepth 1 -printf '%A@\t%p\n' | sort -r | cut -f 2,2 | head -1
get newest file in current directory
Uses UNIX time for sorting.
while IFS= read -r -u3 -d $'\0' file; do file "$file" | egrep -q 'executable|ELF' && chmod +x "$file"; done 3< <(find . -type f -print0)
Functions: chmod egrep file find read
Set executable permissions only to executable files
If you make a mess (like I did) and you removed all the executable permissions of a directory (or you set executable permissions to everything) this can help.
It supports spaces and other special characters in the file paths, but it will work only in bash, GNU find and GNU egrep.
You can complement it with these two commands:
1. add executable permission to directories:
find . type d -print0 | xargs -0 chmod +x
2. and remove to files:
find . type d -print0 | xargs -0 chmod -x
Or, in the same loop:
while IFS= read -r -u3 -d $'\0' file; do case $(file "$file" | cut -f 2- -d :) in :*executable*|*ELF*|*directory*) chmod +x "$file" ;; *) chmod -x "$file" ;; esac || break done 3< <(find . -print0)
Ideas stolen from Greg's wiki: http://mywiki.wooledge.org/BashFAQ/020
find . -type f -name \*.c | while read f; do mv $f "`basename $f .c`".C; done
$ find . -type f -name \*.c | while read f; do mv $f "`basename $f .c`".C; done
kk1.C kk2.C kk3.C kk4.C
recursively change file name extensions
or, for a single directory:
for f in *.c; do mv $f "`basename $f .c`".C; done
vimdiff foo.c <(bzr cat -r revno:-2 foo.c)
Compare a file with the output of a command or compare the output of two commands
find /backup/directory -name "FILENAME_*" -mtime +15 -exec rm -vf {};
sudo ifconfig en1 ether 00:e2:e3:e4:e5:e6
Spoof your wireless MAC address on OS X to 00:e2:e3:e4:e5:e6
If you want to check that the spoof worked, type the same command as earlier:
ifconfig en1 | grep ether
Now you will see:
ether 00:e2:e3:e4:e5:e6
For the wired ethernet port:
sudo ifconfig en0 ether 00:e2:e3:e4:e5:e6
while [[ COUNTER -le 10 && IFS=':' ]]; do for LINE in $(cat /tmp/list); do some_command(s) $LINE; done; COUNTER=$((COUNTER+1)); done
Iterate through a file where instead of Newline characters, values are separated with a non-white space character.
At times I find that I need to loop through a file where each value that I need to do something with is not on a separate line, but rather separated with a ":" or a ";". In this instance, I create a loop within which I define 'IFS' to be something other than a whitespace character. In this example, I iterate through a file which only has one line, and several fields separated with ":". The counter helps me define how many times I want to repeat the loop.
gawk '!/^[\t\ ]*#/{print $0}' filename | strings
File without comments or blank lines.
cmdfu(){ local TCF="/var/tmp/cmdfu"; echo " Searching..."; curl "http://www.commandlinefu.com/commands/matching/$(echo "$@" | sed 's/ /-/g')/$(echo -n $@ | base64)/plaintext" --silent > "$TCF"; vim -c "set filetype=sh" -RM "$TCF"; rm "$TCF"; }
Functions: echo rm vim
Search commandlinefu.com and display with VIMs syntax highlighting!
Multi-argument version, but with VIM loveliness :D
ps awwwux | grep httpd | grep -v grep | awk '{mem = $6; tot = $6 + tot; total++} END{printf("Total procs: %d\nAvg Size: %d KB\nTotal Mem Used: %f GB\n", total, mem / total, tot / 1024 / 1024)}'
Total procs, avg size (RSS) and Total mem use
$ perl -pi -e 's/\r\n/\n/g'
dos2unix
Converts windows lined-style file to unix.
see http://en.wikipedia.org/wiki/Newline
Can be used to convert from linux2dos : just invert \r\n and \n.
cat files.txt | xargs tar -cv | tar -x -c $DIR/
Functions: cat tar xargs
Copy files from list with hierarchy
If you want certain files out of a directory hierarchy, this will copy just the listed files, but will create the directory hierarchy in the new location ($DIR/)
‹ First < 214 215 216 217 218 > Last ›
curl -s "http://services.digg.com/stories?link=$NEWSURL&appkey=http://www.whatever.com&type=json" | python -m simplejson.tool | grep diggs
Functions: grep python
Get number of diggs for a news URL
smbmount ///
Mount Windows shared folder (or Samba share)
bindkey ^f at "#" kill
Kill all windows in one go in gnu screen
Kills all windows in a gnu screen session and terminates it , on pressing Control-f , useful in closing screen session with large number of windows . Add it to your screenrc .
parallel -j+0 lame {} -o {.}.mp3 ::: *.wav
To convert **.wav to **.mp3 using LAME running one process per CPU core run:
Command in description (Your command is too long - please keep it to less than 255 characters)
Functions: command less
YouTube Convert and Download All User's Videos to MP3s on the fly
yt-mp3chanrip() { for count in 1 51 101 151 201 251 301; do for i in $(curl -s http://gdata.youtube.com/feeds/api/users/"$1"/uploads\?start-index="$count"\&max-results=50 | grep -Eo "watch\?v=[^[:space:]\"\'\\]{11}" | uniq); do ffmpeg -i $(wget http://youtube.com/"$i" -qO- | sed -n "/fmt_url_map/{s/[\'\"\|]/\n/g;p}" | sed -n '/^fmt_url_map/,/videoplayback/p' | sed -e :a -e '$q;N;5,$D;ba' | tr -d '\n' | sed -e 's/\(.*\),\(.\)\{1,3\}/\1/') -vn -ab 128k "$(youtube-dl -e http://youtube.com/"$i").mp3"; done; done; unset count i; }
create the function and run with
yt-mp3chanrip YoutubeUsername
Great for channels like ukfDrumAndBass that only post music. No more need for third party browser plugins or websites that only convert one vid one at a time. It'll convert and save to CWD up to 300 of a user's videos to mp3s, one at a time. To increase, just increment the $count pattern. This is a concoction from commands #7718 and #7752, so it uses ffmpeg wget, curl, sed, and youtube-dl -- youtube-dl is only used to get the title of the video which it uses to name the mp3 file. You can use a different naming method if you want and the function should still work.
killall -r 'a regular expression'
killall -r 'chrom' will kill all chromium instances at once
This is usefull when we don't know the exact name of the process, but the application name
A limitation is that the regular expression only tries to match the last part of the full command (i.e. the bin file name itself).
But this is way shorter than the following one:
ps axww | grep SomeCommand | awk '{ print $1 }' | xargs kill
cd /usr/share/gnome-shell/search_providers/ && cat google.xml | sed "s/www.google.com\/search/duckduckgo.com\//; s/Google/DuckDuckGo/g" > duckduckgo.xml
Functions: cat cd sed
Add DuckDuckGo Search as search provider on gnome-shell
Add DuckDuckGo Search as search provider on gnome-shell/gnome3 .
Needs root permission. To see the results, use alt+f2 and then type r.
$ mkdir -p /tmp/dir1/{0..20}
if dir1 does not exists
#!/bin/bash cd /usr/share/consolefonts/; for i in * ; do setfont; echo "testing >> $i << font" ; setfont $i ; showconsolefont ; sleep 5 ; clear ; done
testing >> 165.cp << font
! " # $ % & ' ( ) * + , - . / 0
1 2 3 4 5 6 7 8 9 : ; < = > ? @
A B C D E F G H I J K L M N O P
Q R S T U V W X Y Z [ \ ] ^ _ `
Functions: cd clear echo sleep
view all console fonts
Testing in a TTY terminal , not emulator .
fdupes -r -1 Neu | while read line; do j="0"; buf=""; for file in ${line[*]}; do if [ "$j" == "0" ]; then j="1"; buf=$file; else ln -f $buf $file; fi; done; done
alias dir="ls -al"
alias dir to ls -al
If you come from a DOS background and accidentally use DOS commands often, this and others like it can be helpful. Add to your .bash_profile, or wherever you keep such things.
curl http://root:PASSWORD@ROUTER_DYN_DNS/bwm/tomato_rstatsa001839ceb1d4.gz?_http_id=HTTPID > $HOME/Dropbox/Backups/tomato_stats.gz
Backup your precious Tomato Router Stats
You must get your Backup Url from: http://ROUTER_DYN_DNS/admin-bwm.asp under "Backup".
I set it up in a curl
diskutil list
List all mounted drives and their accompanying partitions from OS X Terminal
pmap $(pgrep [ProcessName] -n) | gawk '/total/ { a=strtonum($2); b=int(a/1024); printf b};'
Functions: gawk pmap printf
Get acurate memory usage of a Process in MegaBytes
find . -type f | sed -n 's/..*\.//p' | sort -f | uniq -ic
Count files by extension
Change "sort -f" to "sort" and "uniq -ic" to "uniq -c" to make it case sensitive.
function geoip() { curl -s "http://www.geoiptool.com/en/?IP=$1" | html2text | egrep --color "IP Address:|Country:|City:|Longitude:|Latitude:|Host Name:" }
[09:46 PM] root@MyServer:~ $ geoip 218.53.106.44
| Host Name: 218.53.106.44 |
| IP Address: 218.53.106.44 |
| Country: Korea,_Republic_Of [korea, republic of] |
| City: Seocho |
| Longitude: 127.0167 |
|____Latitude:_37.4833_______________________________________________________|
Provides external IP, Country and City in a formated manner.
Provides a cleaner output plus some more details about the IP address. Also, a flaw was corrected where the URL provided the results in Spanish by default.
genRandomText() { perl -e '$n=shift; print chr(int(rand(26)) + 97) for 1..$n; print "\n"' $1;}
If you don't have seq, you can use perl.
ipcs -a | grep 0x | awk '{printf( "-Q %s ", $1 )}' | xargs ipcrm
Functions: awk grep ipcs xargs
Clear IPC Message Queue
hdiutil convert /path/imagefile.dmg -format UDTO -o /path/convertedimage.iso
Convert a DMG file to ISO in OS X Terminal
kill -3 PID
How to get full tread dump for java process
Useful command to get information about running java process and treads, to see log look into the default log for your java application
diff -ua <(w3m -dump http://www.php.net/downloads.php|fgrep -A1 '5.2.15 (tar.bz2)'|awk '/md5:/{print $2}') <(md5sum php-5.2.15.tar.bz2|awk '{print $1}')
Functions: awk diff fgrep md5sum
Check the MD5
Use zsh process substitution syntax.
cat /var/log/auth.log | grep -i "pam_unix(sshd:auth): authentication failure;" | cut -d' ' -f14,15 | cut -d= -f2 | sort | uniq
178.170.147.99
184.107.214.162
189.223.99.235.dsl.dyn.telnor.net
200.21.87.167
mail1.zenithinfotech.com
Functions: cat cut grep sort
Get a list of IP Addresses that have failed to login via SSH
This command shows a sorted list of the IP addresses from which there have been authentication errors via SSH (possible script kiddies trying to gain access to your server), it eliminates duplicates so it's easier to read, but you can remove the "uniq" command at the end, or even do a "uniq -c" to have a count of how many times each IP address shows in the log (the path to the log may vary from system to system)
!$ will be expanded to the last argument on the previous command. There are also positionnal parameters like !:1, !:2...
echo -e "[client]\nuser = YOURUSERNAME\npassword = YOURPASSWORD" > ~/.my.cnf
[client]
user = YOURUSERNAME
password = YOURPASSWORD
Passwordless mysql{,dump,admin} via my.cnf file
The file .my.cnf located at user's home directory is used for mysql login. If this file exists, then
mysql -uYOURUSERNAME -pYOURPASSWORD database -e 'SOME SQL COMMAND'
can be replaced with
mysql database -e 'SOME SQL COMMAND'
It saves you from typing!
This is valid for mysqladmin and mysqldump commands as well.
dd if=/dev/zero bs=256M count=1 | nc [remoteIP] [remotePort] and on the other host nc -l port >/dev/null
Functions: dd host
Test network performance, copying from the mem of one box, over the net to the mem of another
Note, the [remotePort] should be opened in the firewall first. First, start the destination box listening, then fire off the sending box. Data from the /dev/zero device in memory of the source machine is read out using dd, sent over the network with nc, and read back in from the other side of the network with nc, going to the /dev/null device. Essentially, it is a memory-network-memory copy operation, the output of dd will tell you how fast your network really is performing.
‹ First < 215 216 217 218 219 > Last ›
check_dns_no() { for i in $* ; do if `wget -O - -q http://www.norid.no/domenenavnbaser/whois/?query=$i.no | grep "no match" &>/dev/null` ; then echo $i.no "available" ; fi ; sleep 1 ;done }
xeor@nibler:~$ check_dns_no test1 test2 test3
test2.no available
test3.no available
Functions: echo grep sleep
Check if a .no domain is available
Mostly for Norwegians, but easily adoptable to others. Very handy if you are brainstorming for a new domainname.
Will only display the available ones..
You can usually do this better with dig, but if you dont have dig, or the TLD only have an online service to check with, this will be usefull..
hdiutil convert /path/imagefile.iso -format UDRW -o /path/convertedimage.dmg
Convert an ISO file to DMG format in OS X Terminal
sed 's/[[:blank:]]*#.*//; /^$/d' filename
This will remove comments that are at the end of lines.
gs -q -sPAPERSIZE=a4 -dNOPAUSE -dBATCH -sDEVICE=pdfwrite -sOutputFile=out.pdf 1.pdf 2.pdf 3.pdf 4.pdf
I found this on http://fixnum.org/blog/2007/concat_pdfs_with_ghostscript/ so it's not my creation, but I think it's very useful and a good addition to this codebase.
ffmpeg -f alsa -i default -f x11grab -s sxga -r 10 -i :0.0 -f mp4 -s vga -sameq out.mp4
capture screen and mic
sxga ==> 1280x1024
vga ==> 800x600
------------------------------------------------
xwininfo -root | grep geometry
ifconfig eth0 hw ether 00:11:22:33:44:55
change mac address
for i in `rpm -qva | sort ` ; do ; echo "===== $i =====" ; rpm -qvl $i ; done > /tmp/pkgdetails
Functions: echo rpm sort
Create a file list of all package files installed on your Red-Hat-like system for easy grepping
This will create the file /tmp/pkgdetails, which will contain a listing of all the files installed on your RPM-based system (RedHat, Fedora, CentOS, etc). Useful should the RPM system/database become corrupted to find which package installed which files.
for URL in `wget -O - http://api.flickr.com/services/feeds/photos_public.gne?tags=bitch,bw 2>/dev/null | grep -E -o "http[^ ]+?jpg" | grep -v "_m" | uniq | grep -v 'buddy' `; do FILE=`echo $URL | grep -E -o "[0-9a-z_]+\.jpg"`; curl $URL > $FILE; done;
A director full of desktop wallpapers showing nice woman ;)
Functions: grep uniq
Grap all images with the tags 'bitch' and 'bw' from a flickr photofeed
tar -tf /path/to/file.tar
lists contents of a tar file
dbus-send --system --print-reply --dest=org.freedesktop.NetworkManager /org/freedesktop/NetworkManager org.freedesktop.NetworkManager.Enable boolean:true
Enable NetworkManager (in KDE)
some times, after package upgrade (debian) or knetworkmanager crashing... NetworkManager turns off (disables). to enable it, use the above command.
tcpdump -i eth0 -n | head
see what traffic is mostly hitting you
Sometimes it is useful to have just a general picture of "what is taking all the bandwidth here". Running this command will limit tcpdump to a few packets (instead of flooding your terminal endlessly) and will provide a small, but sometimes sufficient, sample to determine what is going on.
Useful to quickly diagnose DOS attacks.
time dd if=/dev/zero of=blah.out oflag=direct bs=256M count=1
Let dd use direct I/O to write directly to the disk without any caching. You'll encounter very different results with different block sizes (try with 1k, 4k, 1M, ... and appropriate count values).
ruby -e 'require "date"; puts DateTime.now.cweek'
wget -qO - sometrusted.web.site/tmp/somecommand | sh
download and run script from trusted webserver
This is a simple command that you can run complex shell scripts via ssh. For instance if you would have to run the same process on several hundred hosts. There is no security so you have to trust the server that is sourcing this script.
python -c $(echo -e 'import py_compile\npy_compile.compile("/path/to/script.py")');
Compile python script. Generated file will overwrite anything at /path/to/script.pyc
mv -n * ../; cd ..; rmdir $OLDPWD
Functions: cd mv rmdir
Avoid clobbering files by either overwriting due to name collisions or by assuming the command worked and deleting the target directory.
allVideos() { find ./ -type f -print0 | xargs -0 file -iNf - | grep ": video/" | cut -d: -f1; }
$ find ./ -type f -print0 | xargs -0 file -iNf - | grep ": video/" | cut -d: -f1
./.v.a-desk/atomic_city.wmv
./.mozilla/firefox/yhszbu0k.default/Cache/1/1A/9DD36d01
./.mozilla/firefox/yhszbu0k.default/Cache/7/A6/8BFE0d01
./.mozilla/firefox/yhszbu0k.default/Cache/6/63/FAE2Cd01
./.mozilla/firefox/yhszbu0k.default/Cache/9/D5/E16E0d01
Functions: cut file find grep xargs
Find all videos under current directory using MIME a.k.a not using extension
Videos are found using their MIME type. Thus no need to for an extension for the video file.
This is a efficent version of "jnash" cmd (4086). Thanks for jnash. This cmd will only show video files while his cmd show files having "video" anywhere in path.
curl -s -u username:passwd http://twitter.com/statuses/friends_timeline.rss|grep title|sed -ne 's/<\/*title>//gp' |festival --tts
moreplayingaround
rpm -Va | grep -v "\.\.\.\.\.\.\.T"
Strip out time difference entries when verifying rpms on x86_64 RHEL systems
dd if=/dev/urandom count=200 bs=1 2>/dev/null | tr "\n" " " | sed 's/[^a-zA-Z0-9]//g' | cut -c-16
Functions: cut dd sed tr
expdp user/password FLASHBACK_SCN=$(echo -e "select current_scn from v\$database;" | sqlplus / as sysdba 2>/dev/null| grep [0-9][0-9][0-9][0-9][0-9][0-9]*)
Functions: as echo grep
Consistent Oracle Datapump Export
Creates a consistent datapumpt export on an Oracle database with the current sequence number, while the system is running and changes happens on the database.
for x in `grep server /tmp/error.log | awk '{print $3}'`; do \ t=`date "+%d-%m-%H%M%S"` ; ssh -q -t admin@$x.domain.com 'pstree -auln' > ~/snapshots/$x-$t.out \ done
(One or more files containing process trees (a snapshot) of other machines.)
Functions: awk ssh
Required:
1) Systems that send out alert emails when errors, database locks, etc occur.
2) a system that:
a) has the ability to receive emails, and has procmail installed.
b) has ssh keys set up to machines that would send out alerts.
When procmail receives alert email, you can issue a command like this one (greps and awks may very - you're isolating the remote hostname that had the issue).
This will pull process trees from the alerting machines, which is always useful in later analysis.
find . -type f -iname '*.msh' -exec ls -lG {} \; | awk '{total = total + $4}END{print "scale=2;" total "/2^20"}' | bc
Calculate the size in MB of all files of a certain extension
hdiutil mount -owners on -mountrandom /tmp -stdinpass /path/to/my.sparsebundle
Mount FileVault sparsebundle image manually (e.g.: from TimeMachine disk).
svn ci -m "$(curl -s http://whatthecommit.com | sed -n '//,/<\/p>/p' | sed '$d' | sed 's/
//')"
I know what I am doing. Trust me.
Check in current directory to SVN with commical/terrible commit message. (Please don't actually run this command!)
‹ First < 216 217 218 219 220 > Last ›
mysql -u[user] -p[password] -h [hostname] -D [database] -ss -e "select * from mysql_tbl " | sed 's/\t/","/g;s/^/"/;s/$/"/;s/\n//g' > dump.csv
Run query on remote database and output results as csv
VBoxManage internalcommands createrawvmdk -filename [path/to/file/name.vmdk] -rawdisk /dev/[block_device]
Boot block devices as virtual devices in Virtual Box
VBoxManage internalcommands createrawvmdk -filename ~/.VBox_sdc.vmdk -rawdisk /dev/sdc
In order to start virtual box using block devices, ( Or to boot from it) run as ROOT
sudo VirtualBox
Then add & select the vmdk file as a device.
At last Start the virtual box.
- This cmd needs to run once for a device.
- See command 8936 to run with out using ROOT power and easy handling of Virtual m/c
svn info -R --xml file:///path/to/rep | grep kind=\"file\"|wc -l
1034
Functions: grep info wc
a() { alias $1=cd\ $PWD; }
david@david-laptop:~$ cd Desktop/
david@david-laptop:~/Desktop$ a 1
david@david-laptop:~/Desktop$ cd ../code
david@david-laptop:~/code$ a 2
david@david-laptop:~/code$ alias
alias 1='cd /home/david/Desktop'
alias 2='cd /home/david/code'
david@david-laptop:~/code$ 1
david@david-laptop:~/Desktop$
Easily move around many directories
An easy way to create aliases for moving between many directories
dm display-buffer reset
Resolve the "all display buffers are busy, please try later" error on a Foundry
defaults write com.apple.dashboard devmode YES
Enables widgets to be placed onto the desktop. Click and hold the widget and press F12 to drag it onto the desktop. Repeat the process again to drag a widget back onto the dashboard. You may need to log off or restart for it to take effect.
fortune | cowsay -f tux
Let Tux bring the fortune cookie
ftp-latest <<< "cd /; cls -1 | tail -1 | xargs -I% echo get % | /PATH/TO/ftp-latest"
Get the latest ftp file from ftp server on local machine with lftp and bash. (Piped commands inside lftp).
Require lftp and this script to work (adapt path and credentials as needed):
echo $'#!/bin/bash\n# coded by sputnick under GPL 20101007\nlftp -u user,passwd remoteuser@host.tld -e "$(cat)"' > /PATH/TO/ftp-latest; chmod +x !$
for x in `find /vmfs/volumes/ -name *vmx -exec grep -H linux.iso {} \; |cut -d : -f 1`; do echo $x; grep -i sync $x; done;
[uid0@vmw104 uid0]$ for x in `find /vmfs/volumes/ -name *vmx -exec grep -H linux.iso {} \; |cut -d : -f 1`; do echo $x; grep -i sync $x; done;
find: /vmfs/volumes/5be8b8ea-f45e0707/lost+found: Permission denied
/vmfs/volumes/48536010-b500c483-3917-0018fe7d1464/rhel001/rhel001.vmx
tools.syncTime = "false"
/vmfs/volumes/48536042-2e85c4db-1463-0018fe7d1464/www003/www003.vmx
tools.syncTime = "FALSE"
/vmfs/volumes/48535f1b-50f35e02-be36-0018fe7d1464/WWW013/WWW013.vmx
tools.syncTime = "TRUE"
/vmfs/volumes/498bba03-3db3d1ae-4d9a-00163582428c/www012/www012.vmx
[uid0@vmw104 uid0]$
Functions: cut echo grep sync
Search vmware vmx files if Linux guests are set to sync time to host
besure to adjust your find to use to correct location of your VMX files.
sed -i '/^somestring/ s/^/#/' somefile.cfg
Comment out all lines in a file with "somestring" in the beginning. Sed -i is used for in place edits. Useful if you need to comment out lines beginning with somestring
defaults write /Library/Preferences/com.apple.loginwindow DesktopPicture "/System/Library/CoreServices/Finder.app/Contents/Resources/vortex.png"
Change Mac OS X Login Picture
Change the file location in the second half of the string to the exact file location of your chosen picture.
axi-cache search
29 results found.
Results 1-20:
100% xapian-tools - Basic tools for Xapian search engine library
97% apt-xapian-index - maintenance tools for a Xapian index of Debian packages
92% php5-xapian - Xapian search engine interface for PHP5
92% python-xapian - Xapian search engine interface for Python
90% libsearch-xapian-perl - Perl bindings for the Xapian search library
89% libxapian-ruby1.9.1 - Xapian search engine interface for Ruby 1.9.1
89% libxapian-ruby1.8 - Xapian search engine interface for Ruby 1.8
88% tclxapian - Xapian search engine interface for Tcl
88% xapian-examples - Xapian simple example programs
88% xapian-omega - CGI search interface and indexers using Xapian
87% xapian-doc - Core Xapian documentation
82% python-django-djapian - Search API for Django using Xapian
81% libxapian22-dbg - Debugging symbols for the Xapian Search engine library
81% libxapian15-dbg - Debugging symbols for the Xapian Search engine library
80% libxapian-dev - Development files for Xapian search engine library
78% ept-cache - Commandline tool to search the package archive
75% libept1 - High-level library for managing Debian package information
75% libept0 - High-level library for managing Debian package information
74% libept-dev - High-level library for managing Debian package information
73% python-xappy - easy-to-use interface to the Xapian search engine
More terms: search searching indexing probabilistic stemming collections ranked
More tags: web::search-engine use::searching implemented-in::c++ works-with::text works-with-format::plaintext works-with::software:package suite::debian
`axi-cache more' will give more results
A better 'apt-cache' using Xapian to rank results
A replacement for 'apt-cache' that uses a Xapian to produce ranked results. Available in 'apt-xapian-index' 0.27 and higher.
cat dvd_output/Layer0/IMAGE.DAT dvd_output/Layer1/IMAGE.DAT > dvd.iso
Combine DVD Studio Pro DDP layers back into a DVD disc image for testing
This will you combine the DDP output of DVD Studio Pro back into a standard ISO disk image so that you can double-check the DDP output process.
ps axo pid,ppid | awk "{ if ( \$2 == $PID ) { print \$1 }}")
find . -exec touch {} \;
Recursively touch all files and subdirectories
find . -type f -name "*.py" -exec wc -l {} \; | awk '{ SUM += $1} END {print SUM }'
16809
Functions: awk find wc
Find lines of code (LOC) of a filetype in a project.
Replace .py with .rb or .java to get the LOC of that particular filetype. An alternative is http://www.commandlinefu.com/commands/view/2812/make-a-statistic-about-the-lines-of-code
find /var/spool/mqueue -type f -mtime +7 | perl -lne unlink
Find all e-mails older than 7 days in the queue and delete them
Find all files in /var/spool/mqueue older than 7 days, pass to perl to efficiently delete them (faster than xargs or -exec when you've got millions or hundreds of thousands to delete). Naturally the type, directory, and file age vars can be adjusted to meet your specific needs.
^z; bg; disown
background and disown, but with a proper one-line syntax
$foo[(I)$foo[-1]]
%foo=(a b c d e)
%echo $foo[(I)$foo[-1]]
Get length of array in zsh
Returns the index of the last element in the array.
curl -s http://whatthecommit.com | html2text | sed '$d'
I don't know what these changes are supposed to accomplish but somebody told me
to make them.
Requires html2text. Print bad, but often funny commit messages from whatthecommit.com
sudo lsof | grep 'DEL.*lib' | cut -f 1 -d ' ' | sort -u
Functions: cut grep sort sudo
ps -ef | grep $USER
username 8804 8802 0 09:03:19 pts/5 0:00 -tcsh
username 8802 8799 0 09:03:19 ? 0:01 /usr/lib/ssh/sshd
username 9020 8804 0 09:53:33 pts/5 0:00 ps -ef
username 9021 8804 0 09:53:33 pts/5 0:00 grep username
Find all processes running under your username.
I like to make it an alias in my .bashrc file, as such:
alias psme='ps -ef | grep $USER'
watch ethtool eth0
require: ethtool
How to know if your NIC receive link
verifry if link detected or no and speed of network.
egrep -r '(render_message|multipart).*('`find app/views -name '*.erb' | grep mailer | sed -e 's/\..*//' -e 's/.*\///' | uniq | xargs | sed 's/ /|/g'`')' app/models
Functions: egrep grep sed uniq xargs
Finds all of the mailers being used in your rails app
emacs doctor
I am the psychotherapist. Please, describe your problems. Each time you are finished talking, type RET twice.
How do you do? What brings you to see me?
Talk to the doctor (Eliza-like)
An easter-egg from emacs.
‹ First < 217 218 219 220 221 > Last ›
svn status | grep -v ? | awk '{print $2}' > file.svn.txt && svn ci --targets file.svn.txt -m "[your commit message here]"
Commit current modified or added files in current svn repository
echo -e "package1 option1/question1 boolean true\npackage2 option2/question2 boolean true\n" > autoprefs; sudo debconf-set-selections < autoprefs; rm autoprefs
Functions: echo rm sudo
With this command, you do not have to confirm licences answers during packages installation! Only for Debian-derivate distributions.
e.g.:
echo -e "sun-java6-jdk shared/accepted-sun-dlj-v1-1 boolean true\nsun-java6-jre shared/accepted-sun-dlj-v1-1 boolean true\nsun-java6-bin shared/accepted-sun-dlj-v1-1 boolean true\nvirtualbox virtualbox/module-compilation-allowed boolean true\nvirtualbox virtualbox/delete-old-modules boolean true\nvirtualbox virtualbox/group-vboxusers boolean true\n" > autoprefs; sudo debconf-set-selections < autoprefs; rm autoprefs
curl -s http://boards.4chan.org/wg/|sed -r 's/.*href="([^"]*).*/\1\n/g'|grep images|xargs wget
Im' not interested in images, but that's how I would do it.
du -ms * | sort -nr
Sort all files and directories by size, rounded to the nearest megabyte. (Substitute custom path for *.)
edit list of files in last command
say you've just found all the config files with this command
find . -name '*.config'
and you need to edit them all
will re-execute the command and present them to vi in the argument list
don't use if the list is really long as it may overflow the command buffer
path+=( /sbin /usr/sbin /usr/local/sbin ); path=( ${(u)path} );
Add the sbin directories to your PATH if it doesn't already exist in ZSH.
On RHEL, Fedora and CentOS systems, and maybe others, the sbin directories aren't in the user's $PATH. For those systems that use 'sudo', this can be inconvenient typing the full path all the time. As a result, you can easily take advantage of adding the sbin directories to your PATH by adding this simple line to you .zshrc.
ffmpeg -i file.flv file.avi
I'm not well enough versed in the differences between ffmpeg & mencoder to know which one is better.
REALUSERID=`TTYTEST=$(ps | awk '{print $2}' |tail -1); ps -ef |grep "$TTYTEST$" |awk '{print $1}'`;echo $REALUSERID
USERNAME
Functions: awk echo grep ps tail
Find the USERid of a SUDOed user
Find the USERid of a SUDOed user who has either left their terminal logged in or for scripting purposes to track who ran what commands.
This only applys to users that do sudo su - USERNAME. not sudo su USERNAME
Sudo su without the dash allows use of (echo $SUDO_USER)
for F in `find ./ -type f`;do SIZE=`ls -s $F | awk -F" " '{print $1}'`; dd if=/dev/urandom of=$F bs=1024 count=$SIZE;done
Functions: awk dd
Simple file wipe
This will find any regular file starting with the current directory and use /dev/urandom to overwrite that file. It will is the same size of the file (in blocks) as the file. Can't handle files with spaces or odd characters in the name (who does that anyway?)
yum remove `rpm -qa --qf "%{n}.%{arch}\n"|grep i386`
Remove i386 RPM packages from x86_64 CentOS/RHEL
cvs -Q status | perl -ne 'print if m/^File.+Status: (?!Up-to-date)/ .. m/^=/;'
% cvs -Q status | perl -ne 'print if m/^File.+Status: (?!Up-to-date)/ .. m/^=/;'
File: Linux-rhel-5 Status: Needs Patch
Working revision: 1.68
Repository revision: 1.69 /home/myhome/project/software/scripts/steps/000-define-functions/Linux-rhel-5,v
===================================================================
File: Linux-rhel-6 Status: Needs Patch
Working revision: 1.20
Repository revision: 1.21 /home/myhome/project/software/scripts/steps/400-inittab/Linux-rhel-6,v
Working revision: 1.3
Repository revision: 1.4 /home/myhome/project/software/scripts/steps/451-snmp/Linux-rhel-6,v
Functions: cvs perl
This will also print the path to file which is not included in the other examples.
for i in somefiles*.png ; do echo "$i" ; N=$(stat -c %Y $i); mv -i $i $N.png; done
Screenshot-10.png
Screenshot-12.png
Screenshot-13.png
Screenshot-8.png
Screenshot-9.png
Becomes:
1274847969.png
1274848115.png
1274848316.png
1274848762.png
1275016796.png
Functions: echo mv stat
Batch rename files by their epoch last modified time.
This renames a pattern matched bunch of files by their last modified time.
rename by timestamp
rename by time created
rename by time modified
vim !$
$ ls test.txt
$ vim !$
use !$ to retrieve filename used with last command
the second command 'vim !$' will open test.txt to edit
0 0 * * 0 /usr/bin/mysqldump -uroot -p'' data_base_name > /home/bob/XYZ_DB_BACKUP/$(date +\%Y-\%m-\%d_\%Hh\%M).sql
backup mysql database
Create a cronjob that runs weekly to backup your database to a file.
iptables -A FORWARD -i br0 -m iprange --src-range 192.168.0.x-192.168.0.y -m iprange --dst-range 192.168.0.w-192.168.0.z -j DROP
Cloack an IP range from some IPs via iptables
watch -n1 "ls -p | grep '/$'"
Watching directories
find ~/random_jpegs/folder -name "*.jpg" -exec rdjpgcom {} \;
CREATOR: gd-jpeg v1.0 (using IJG JPEG v62), quality = 95
displays comments from random jpeg files.
depends on libjpeg-progs
But how to display path to found comments?
sed 's/\b\(0*\)//g' filename
$ cat filename
$ sed 's/\b\(0*\)//g' filename
Remove leading zeros in multiple columns with sed
Leading zeros might help correct sorting and they can be removed by sed after sorting
for i in *.tar.gz; do tar -xzf $i; done
Extract multiple file in a directory
You can flexibly change file pattern(*.tar.gz) and uncompress command to other job!
Example, remove all files :
for i in *.tar.gz; do rm $i; done
(Just for example, because if you really want to remove file, simply use wildcard like this rm *.tar.gz)
print -s "PATH='$PATH'"
put environment variable in history to edit
say you want to edit your PATH variable using bash/zsh commandline editing, this will put something like this in history so you can edit it:
PATH=/bin:/usr/bin:/usr/sbin
to make this a shell function such that:
eev HOME
will put /home/dave in the last history event:
eev()
print -s "$1='$(eval echo \$$1)'"
sqlite3 mydb.sqlite3 '.dump' | grep -vE '^(BEGIN|COMMIT|CREATE|DELETE)|"sqlite_sequence"' | sed -r 's/"([^"]+)"/`\1`/' | tee mydb.sql | mysql -p mydb
Functions: grep sed tee
Transfer sqlite3 data to mysql
Filters out all non-insert SQL operations (we couldn't filter out only lines starting with "INSERT" because inserts can span multiple lines), quotes table names with backticks, saves dump to a file and pipes it straight to mysql.
This transfers only data--it expects your schema is already in place. In Ruby on Rails, you can easily recreate the schema in MySQL with "rake db:schema:load RAILS_ENV=production".
iptables-save > firewall.conf; rm -f /etc/network/if-up.d/iptables; echo '#!/bin/sh' > /etc/network/if-up.d/iptables; echo "iptables-restore < firewall.conf" >> /etc/network/if-up.d/iptables; chmod +x /etc/network/if-up.d/iptables
Functions: chmod echo iptables iptables-save rm
Persistent saving of iptables rules
a simple command in order to make iptables rules permanent, run @ sudo!
cat LOCALFILE | ssh HOST "cat > REMOTEFILE"
Nice command for when you don't have scp available for whatever reason.
Works with binaries.
sox -t alsa default ./recording.flac silence 1 0.1 5% 1 1.0 5%
SoX recording audio and trimming silence
Records audio from your mic in FLAC (Free Lossless Audio Codec) format, starts only after it detects at least 0.1 seconds of noise and stops after 1 second of silence. You can adjust the percent values (sensitivity) to best fit your microphone and voice (0.1% if you have a great quality mic, higher if you don't, 0% does not trim anything).
Useful for speech recognition in conjunction with my previous command titled 'Google voice recognition "API"' (http://www.commandlinefu.com/commands/view/8043/google-voice-recognition-api).
‹ First < 218 219 220 221 222 > Last ›
find /path/folder -type f -name "*.*" -print -exec rm -v {} + | wc -l;
Functions: find rm wc
Count the number of deleted files
It does not work without the verbose mode (-v is important)
alias ::='cd ../../'
# Add as many levels as you need
alias :::='cd ../../../'
/home/you/src/some_project/tests
$ ::
/home/you/src
Quick aliases for going up a directory tree
hexdump -v -e '"\\""x" 1/1 "%02x" ""'
convert binary data to shellcode
yt2mp3(){ for j in `seq 1 301`;do i=`curl -s gdata.youtube.com/feeds/api/users/$1/uploads\?start-index=$j\&max-results=1|grep -o "watch[^&]*"`;ffmpeg -i `wget youtube.com/$i -qO-|grep -o 'url_map"[^,]*'|sed -n '1{s_.*|__;s_\\\__g;p}'` -vn -ab 128k "`youtube-dl -e ${i#*=}`.mp3";done;}
squeezed the monster (and nifty ☺) command from 7776 from 531 characters to 284 characters, but I don't see a way to get it down to 255. This is definitely a kludge!
wget -qO - "http://www.google.com/dictionary/json?callback=dict_api.callbacks.id100&q=steering+wheel&sl=en&tl=en&restrict=pr,de&client=te" | sed 's/dict_api\.callbacks.id100.//' | sed 's/,200,null)//'
Google dictionary of word definitions
wget -qO - "http://www.google.com/dictionary/json?callback=dict_api.callbacks.id100&q=steering+wheel&sl=en&tl=en&restrict=pr,de&client=te"
this does the actual google dictionary query, returns a JSON string encapsulated in some fancy tag
sed 's/dict_api\.callbacks.id100.//'
here we remove the tag beginning
sed 's/,200,null)//'
and here the tag end
There are also some special characters which could cause problems with some JSON parsers, so if you get some errors, this is probably the case (sed is your friend).
I laso like to trim the "webDefinitions" part, because it (sometimes) contains misleading information.
sed 's/\,\"webDefinitions.*//'
(but remember to append a "}" at the end, because the JSON string will be invalid)
The output also contains links to mp3 files with pronounciation.
As of now, this is only usable in the English language. If you choose other than English, you will only get webDefinitions (which are crap).
dig commandlinefu.com | sed -nr 's/^[^;].*?\s([.0-9]{7,15})$/\1/ p'
208.94.117.60
208.94.117.125
gets the bare ip(s) of a domain
Strips the non-ip information from the dig output. Could be combined with "head -1" to ensure a single ip is returned. Useful for outputting as a variable for use in scripts.
python fsrecovery.py -P 0 -f /Data.fs /Data.fs.packed
When need to compress the Zope Database
When need to pack the ZODB...
sh -c 'if pgrep x2vnc && env LC_ALL=C xmessage -button "Kill it:0,Ignore it:1" "Another connection is already running. Should I kill it instead of ignoring it?"; then killall x2vnc; fi; x2vnc -passwd /home/Ariel/.vnc/passwd -east emerson:0'
Functions: env killall sh
create an application launcher shortcut that allow only one process of it running
This command is suitable to use as application launching command for a desktop shortcut. It checks if the application is already running by pgrepping its process ID, and offer user to kill the old process before starting a new one.
It is useful for a few x11 application that, if re-run, is more likely a mistake. In my example, x2vnc is an x11 app that does not quit when its connection is broken, and would not work well when a second process establish a second connection after the first broken one.
The LC_ALL=C for xmesseng is necessary for OpenSUSE systems to avoid a bug. If you don't find needing it, remove the "env LC_ALL=C" part
sudo dpkg --configure --pending
Fixing broken packages in Debian systems
For resuming installation of an interrupted apt-get install instruction.
for file in *; do mv -v "$file" "$(sed 's/ //g' <(echo $file))"; done
`test 0' -> `test0'
`test 1' -> `test1'
`test 2' -> `test2'
`test 3' -> `test3'
`test 4' -> `test4'
`test 5' -> `test5'
`test 6' -> `test6'
`test 7' -> `test7'
`test 8' -> `test8'
`test 9' -> `test9'
Renames all files in the current directory such that the new file contains no space characters.
This is a better version, as it does no command piping, uses for instead of while loops, which allows for a list of files in the current working directory to be natively processed. It also uses the -v/verbose option with mv to let you know what the command is doing.
While the command does exactly the same in a better way, I would modify the sed option to replace spaces with underscores instead, or dashes.
Please note that you'll receive errors with this command as it tries to rename files that don't even have spaces.
This is an alternative to: http://www.commandlinefu.com/commands/view/8761/renames-all-files-in-the-current-directory-such-that-the-new-file-contains-no-space-characters.
echo "foo/ bar//" | sed 's:/*$::'
foo/ bar
Remove trailing forward slashes from text.
Useful when manipulating folders' paths fed as arguments. Remove only the forward slashes as the end; multiple ones are removed as well.
perl -pi -e 's/localhost/replacementhost/g' *.php
simple perl global search and replace in files
curl -s --data-urlencode 'longUrl='$1 --data-urlencode 'login='$login --data-urlencode 'apiKey='$apikey 'http://api.bit.ly/shorten?version=2.0.1&format=xml' | xmlstarlet sel -T -t -m "//shortUrl" -v "." | line
[16:58][~]$ bitly http://google.com
http://bit.ly/4sloPA
Shorten url using bit.ly API
It uses curl --url-encode to encode long URLs *properly* and parses XML with xmlstarlet.
If ~/.bitlyrc were to contain
login:apikey
then a script could read the apiKey and login from ~/.bitlyrc like so:
login=$(sed 's/:.*//' < $HOME/.bitlyrc)
apikey=$(sed 's/[^:]*://' < $HOME/.bitlyrc)
files=(/usr/share/cowsay/cows/*);cowsay -f `printf "%s\n" "${files[RANDOM % ${#files}]}"` "`fortune`"
/ A kind of Batman of contemporary \
| letters. |
| |
\ -- Philip Larkin on Anthony Burgess /
Random cow tells your fortune
Can be installed in the root crontab if you want it to update your motd.
If not on ubuntu you need to change /usr/share/cowsay/cows/* to the location of your cow files.
x11vnc -rfbauth /etc/x11vnc.pass -o /tmp/x11vnc.log -forever -bg -noxdamage -rfbport 5900 -avahi -display :0
X11vnc starting session command
a typical X11vnc command
files=$(find /dir/file -name *.txt -exec grep -l a {} \;) && perl -p -i -e 's/old/new/g;' $files
find multiple files in directory and perform search and replace on each of them
echo "command lines" | rev | cut -c 2- | rev
command line
Functions: cut echo ping rev
Remove the last string character using rev and cut
In case sed and awk are not available you may use this to remove the last character from a string with "rev" and "cut".
sed -i -e 's/war/peace/g' *
Replace strings in files
Replace the word 'war' to word 'peace' in every file in the current directory.
dpkg-query -W -f='${Version}' package-name
echo "text" | sudo tee -a /path/file.conf > /dev/null
Insert text at the end of a root-privileged file
You can add repositories, options etc to any .conf in you system!
export PS1='[\[\e[36;1m\]\u@\[\e[32;1m\]\h \[\e[31;1m\]\w]# \[\e[0m\]'
ip -f inet addr |grep "global eth0$"|awk '{print $2}'|cut -d '/' -f 1
get eth0 ip address
for i in `seq -w 1 50`; do wget --continue \ http://commandline.org.uk/images/posts/animal/$i.jpg; done
netstat -rn | convert label:@- netstat.png
Command results as an image capture
We use the "convert" command (ImageMagick package) : see man convert (http://www.ma.utexas.edu/cgi-bin/man-cgi?convert+1)
tail -f --retry /var/log/syslog /var/log/auth.log | ccze -A
Syslog System Reporting in a shell
‹ First < 219 220 221 222 223 > Last ›
watch -n 1 "ps aux | sed -n 's/ D /&/p'"
Watch those evil Red Hat states code D Uninterruptible sleep (usually IO).
On my cluster a D in the states column means it is time to reboot the server.
du -h |grep -P "^\S*G"
Functions: du grep
List Big Files/Directories
This Command will list files & folders which are in GBs.
G can be replace by M to get files in MBs.
dvgrab - | mplayer -
Grabs video from dv firewire camera and plays it on mplayer.
readlink -f
Find out actual full path of
Ever tried to mess with links and/or ../ in the file path? This command outputs the fully resolved path to the actual file passed on the command line.
sed -n '1~5{N;N;p}' file.txt
sed '4~5,+1d' file.txt
pick up 3 lines start at every 5th line of file.txt
sed '4~5,+1d' file.txt
netstat -anp --tcp --udp | grep LISTEN
iscsiadm -m node -l
Attach all discovered iscsi nodes
We can list the new disk with
fdisk -l
sed -n '/05\/Dec\/2010/,$ p' access.log | goaccess -s -b
Total Requests 1171190 Unique Visitors 39270 Referrers 3314 Log N/A
Analyze Apache Web Log Statistics starting on DATE x
map() { if [ "$1" != "" ]; then alias $1="cd `pwd`"; fi }
~ $ cd /some/deep/down/path/to/my/logs
logs $ map log
logs $ cd /some/other/path/to/my/configs
configs $ map conf
configs $ cd
~ $ log
logs $ conf
configs $
Quickly create an alias for changing into the current directory
Put the function in your .bashrc and use "map [alias]" to create the alias you want. Just be careful to not override an existing alias.
curl -s http://www.perl.org/get.html | grep -m1 '\.tar\.gz' | sed 's/.*perl-//; s/\.tar\.gz.*//'
Print the lastest stable version of Perl
hdiutil mount sample.iso
Mount an ISO image on Mac OS X
netstat -ltun
$ netstat -ltun
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 0.0.0.0:60454 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:51413 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN
tcp6 0 0 :::51413 :::* LISTEN
tcp6 0 0 ::1:631 :::* LISTEN
udp 0 0 0.0.0.0:45378 0.0.0.0:*
udp 0 0 0.0.0.0:68 0.0.0.0:*
udp 0 0 192.168.168.192:21328 0.0.0.0:*
udp 0 0 0.0.0.0:5353 0.0.0.0:*
udp 0 0 192.168.168.192:1900 0.0.0.0:*
Works only on Linux.
Last option (n) turn name of service resolving (/etc/services) off.
curl -s 'xkcd.com' | awk -F\" '/^![]()
\n\n- \n
%s \n %s \n %s \n \n \n", $6, $4, $2)}'
-
Spinal Tap Amps
Wow, that's less than $200 per ... uh ... that's a good deal!
http://imgs.xkcd.com/comics/spinal_tap_amps.png
I wasn't sure how to display the image, so I thought I'd try xml for a different twist.
tar -xi < *.tar
Extract multiple tar files at once in zsh
tar doesn't support wildcard for unpacking (so you can't use tar -xf *.tar) and it's shorter and simpler than
for i in *.tar;do tar -xf $i;done (or even 'for i in *.tar;tar -xf $i' in case of zsh)
-i says tar not to stop after first file (EOF)
string="${string^}"
string="hello"
string="${string^}"
echo $string
Convert first letter of string to uppercase
Let bash do the work by converting the initial of a string to an uppercase
sleep 15m; yes > /dev/dsp
Functions: sleep yes
Just replace 15m with desired time. no suffix or 's' for seconds; 'h' for hours
You need to be root or in audio group to write to /dev/dsp.
You may use yes | head -n 2000 for about 1 second beep.
Wrote this as echo -e '\a' not always works as desired (ex. visual bell)
cp /dev/cdrom file.iso
aptitude search ~d "irc client"|grep -i "irc client"
p cgiirc - web based irc client
p epic4 - epic irc client, version 4
p epic4-help - help files for epic4 IRC client
p epic5 - epic irc client, version 5
p erc - an IRC client for Emacs
p irssi - terminal based IRC client
p irssi-dev - terminal based IRC client - development fi
repository search
This is the best way I have found to search out an application when I am not sure the title.
Grep is just to remove anything that does not contain the term in the title or short description (lots of things might include the search term in the description, such as libraries used by the application)
diff -U 9999 file_a file_b | tail -n +3 | grep -P "^(\ Header|\-|\+)"
Header1
- y
+ f
Header2
- C
+ D
Header3
- 3
+ 1
Functions: diff grep tail
Maybe very limited in its applicability but could be of use at times.
egrep -v "^\s*(#|$)" boring.conf
Prints a file leaving out all blank lines and comment-only lines
- is empty
- contains only spaces or tabs
- starts with #
- starts with spaces/tabs followed by a #
echo "0t${currentEpoch}=Y" | /usr/bin/adb
# currentEpoch='1244172897'
# echo "0t${currentEpoch}=Y" | /usr/bin/adb
this works on Solaris, so not better than the "only-GNU"-tool :-(
I think, there is no one-liner for this, that will work on all *nix-es
wget -q --spider http://server/cgi/script
I don't know if the --spider option works to execute a script, but it might be worth trying. Note that the Drupal project uses the following in a cron job.
wget -O - -q http://localhost/drupal/cron.php
The output is sent to standard out so it can be logged by cron.
useradd -m -p $(perl -e'print crypt("pass", "mb")') user
root# useradd -m -p $(perl -e'print crypt("foo", "aa")') foo
user$ su - foo
Password: foo
foo$ ^D
root# userdel -r foo
Functions: perl useradd
Create new user with home directory and given password
Function: char * crypt (const char *key, const char *salt)
The crypt function takes a password, key, as a string, and a salt character array which is described below, and returns a printable ASCII string which starts with another salt. It is believed that, given the output of the function, the best way to find a key that will produce that output is to guess values of key until the original value of key is found.
The salt parameter does two things. Firstly, it selects which algorithm is used, the MD5-based one or the DES-based one. Secondly, it makes life harder for someone trying to guess passwords against a file containing many passwords; without a salt, an intruder can make a guess, run crypt on it once, and compare the result with all the passwords. With a salt, the intruder must run crypt once for each different salt.
For the MD5-based algorithm, the salt should consist of the string $1$, followed by up to 8 characters, terminated by either another $ or the end of the string. The result of crypt will be the salt, followed by a $ if the salt didn't end with one, followed by 22 characters from the alphabet ./0-9A-Za-z, up to 34 characters total. Every character in the key is significant.
For the DES-based algorithm, the salt should consist of two characters from the alphabet ./0-9A-Za-z, and the result of crypt will be those two characters followed by 11 more from the same alphabet, 13 in total. Only the first 8 characters in the key are significant.
sed -i -e '/foo/p' -e 's/foo/barfoo/' file
Useful to duplicate and change iptables rules
$ find . -iname *.mp3 | while read line ; do ln -s "$line" $(echo -e "$line" | openssl md5).mp3 ; done ; mpg123 *.mp3
Functions: echo find ln mpg123 read
‹ First < 220 221 222 223 224 > Last ›
ifconfig | awk '/HWaddr/ { print $1, $5 }'
Why use grep and awk?
nc $telnetserver 23 < $commandfile
pipe commands from a textfile to a telnet-server with netcat
sends commands specified in $commandfile to the telnet-server specified by $telnetserver.
to have newlines in $commandfile interpreted as ENTER, save the file in CR+LF (aka "Windows-Textfile") format.
if you want to save the output in a separate file, use:
nc $telnetserver 23 < $commandfile > $resultfile
perl -e "print scalar(gmtime(1247848584))"
print scalar gmtime
alias big='BIG () { find . -size +${1}M -ls; }; BIG $1'
$ big 100
Functions: alias find
Find large files in current directory
This is for bash - make an alias - also a good blueprint for making aliases that take arguments to functions. If for Solaris use "-size +${1}000000c" to replace "-size +${1}M"
find /var/log -iregex '.*[^\.][^0-9]+$' -not -iregex '.*gz$' 2> /dev/null | xargs tail -n0 -f | ccze -A
View all new log messages in real time with color
lvs | awk '{printf("/dev/%- 40s %-7s %10s %20s %6s %5s %5s %5s %5s\n", $2 "/" $1, $3, $4, $5, $6, $7, $8, $9, $10)}'
Print full LVM LV paths (for copy&paste)
find . -iname "*wav" > step1 ; sed -e 's/\(^.*\)wav/\"\1wav\" \"\1mp3\"/' step1 > step2 ; sed -e 's/^/lame /' step2 > step3 ; chmod +x step3 ; ./step3
Functions: chmod find sed
command for converting wav files to mp3
rpm -qa --qf '%{name}-%{version}-%{release}.%{arch}\n'
kernel-2.6.27.12-170.2.5.fc10.i686
kerneloops-0.12-1.fc10.i386
kernel-2.6.27.19-170.2.35.fc10.i686
kernel-firmware-2.6.27.19-170.2.35.fc10.noarch
kernel-2.6.27.9-159.fc10.i686
kernel-headers-2.6.27.19-170.2.35.fc10.i386
List all rpms on system by name, version and release numbers, and architecture
The queryformat option can be used in a number of ways to find things like duplicate packages, wrong arch, or the exact package to pass to rpm -e, yum remove, etc.
function ec() { ec_var="`pwd`" && cd /etc/ && sudo bzr commit -m "$@" && cd $ec_var; }
Functions: cd sudo
alias for etckeeper, to commit changes after moification of etc
ec commits changes to etckeeper
must have etckeeper installed with bzr to use this
place inside bashrc
can be used from any directory to commit changes
let utime=$offsetutc*3600+$(date --utc +%s)+3600; date --utc --date=@${utime}
utc: Fri Aug 7 23:07:24 UTC 2009
utc+2: Sat Aug 8 01:07:24 UTC 2009
prints out the time for the timezone specified in $offsetutc. So you have less to think about things like: "I'm in utc+4 and my friend in utc-7, can I call him now or will I wake him?"
Note: $offsetutc should be an integer between -12 and 12.
alias rdp='rdesktop -u -g 1600x1200 -D -r disk:home=/home -r clipboard:PRIMARYCLIPBOARD'
$ rdp tcdinas0
Autoselected keyboard map en-us
Quick Full Screen RDP connection
Sets an alias to remote desktop to the specified console, along with options to ensure the RDP session takes up the whole screen, includes a home directory mapping, and clipboard mappings.
yum remove \*.i\?86
sudo ps -Aely --sort:rss | awk '{print $NF": "$8/1024" MB"}' | column -t | less
Functions: awk column ps sudo
Find and sort by Resident Size of each process on the system in MB
tidy -asxhtml -numeric < index.html > index.xml
Convert HTML file into valid XML
^D
Exit shell faster
Use ^D instead of exit.
Also ^D ends input stream when you use terminal for typing into standard input.
for file in ; do cp $file{,.bak} && sed 's/old/new/g' $file.bak > $file; done
Functions: cp file sed
"&&" runs sed if and only if the backup completed and /bin/cp exited cleanly. Works for multiple files; just specify multiple filenames (or glob). Use -v switch for cp to play it safe.
echo $(echo $(seq $MIN $MAX) | sed 's/ /+/g') | bc -l
Functions: bc echo sed seq
Triangular Number
exp="(2+3.0)/7.0*2^2"; val=$(awk "BEGIN {print $exp}" /dev/null)
echo $val #2.85714
a simple trick to do floating point operations in shell, use awk. You can evaluate any complicated expressions which can be evaluated in C.
TTY=$(tty | cut -c 6-);who | grep "$TTY " | awk '{print $6}' | tr -d '()'
Functions: awk cut grep tr tty
Which machine have I logged in from?
find / -name core | xargs /bin/rm -f
Find and remove files
perl -ne 'print if m{\Q/*\E}x .. m{\Q*/\E}x or m{\/\/}x' *.c
more idiomatic version of the same, using the flip-flop-operator; also printing lines with '//'-style comments
sudo ettercap -T -w out.pcap -i wlan0 -M ARP // //
Sniff who are using wireless. Use wireshark to watch out.pcap :]
(cd src && tar -cf - .) | (cd dest && tar -xpf -)
Tar Pipe
Simple tar pipe to be used to copy directories while including hidden files and maintaining file permissions
cat /file/way/somelogforexample | grep -o "[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}" | sort -n | uniq -c | sort -n
Functions: cat grep sort uniq
Cat(print) and sort all IPs from file
Very useful for logs
man -t man | ps2pdf - temp.pdf; evince temp.pdf &> /dev/null &; sleep 3; rm temp.pdf
Functions: man rm sleep
Render man page in *temporary* PDF (works in Gnome)
Yeah yeah, another "render man page in pdf", but this time it creates a temporary PDF that stays resident in memory for viewing, but is eliminated on the filesystem.
Replace evince with your PDF viewer of choice.
‹ First < 221 222 223 224 225 > Last ›
sed -i 's/^/#/' FILENAME
Simple Comment an entire file
With this simple sed command we can easily comment and entire file.
[[ "x$TERM" == "xrxvt" || "x$XTERM_VERSION" == xXTerm* || "x$COLORTERM" == 'gnome-terminal' && "x$SHELL" == */bin/zsh ]] && preexec () { print -Pn "\e]0;$1\a" }
Found another way, more compatible. Tested with xterm, aterm, gnome-terminal and rxvt (where it sets the window title) and guake (where it doesn't - after all, guake does not show the window title).
aptitude -F '%p %v#' search
$ aptitude -F '%p %v#' search zsh$
zsh 4.3.2-25
Supports regex pattern and very flexible output parameters and search options.
du --max-depth=1 | sort -nr | awk ' BEGIN { split("KB,MB,GB,TB", Units, ","); } { u = 1; while ($1 >= 1024) { $1 = $1 / 1024; u += 1 } $1 = sprintf("%.1f %s", $1, Units[u]); print $0; } '
Show total size of each subdirectory, broken down by KB,MB,GB,TB
(uuencode foo.txt foo.txt; uuencode /etc/passwd passwd.txt)|mailx -s "Pandaren!" someone@cmdfu.com
Functions: mailx uuencode
Send multiple attachments using mailx
If you're users have ever asked your script to email their reports in separate attachments instead of tar'ring them into one file, then you can use this. You'll need the mailx package of course. In Unix you'd want to add an additional parameter "-m"
(uuencode foo.txt foo.txt; uuencode /etc/passwd passwd.txt)|mailx -m -s "Hooosa!" someone@cmdfu.com
dog --links "http://www.domain.com"
tar cf - . |(cd /targetdir; tar xvf -)
tar's and moves all contents of current directory to target dir
for x in 8svx aif aifc aiff aiffc ... wv wve xa xi ; do echo $x ; play -q -t $x soundfile trim 0 3 ; done
for x in 8svx aif aifc aiff aiffc al amb au avr caf cdda cdr cvs cvsd cvu dat dvms f32 f4 f64 f8 fap flac fssd gsm hcom htk ima ircam la lpc lpc10 lu mat mat4 mat5 maud nist ogg paf prc pvf raw s1 s16 s2 s24 s3 s32 s4 s8 sb sd2 sds sf sl smp snd sndfile sndr sndt sou sox sph sw txw u1 u16 u2 u24 u3 u32 u4 u8 ub ul uw vms voc vorbis vox w64 wav wavpcm wv wve xa xi ; do echo $x ; play -q -t $x soundfile trim 0 3 ; done
cycle through everything sox knows how to read, playing only the first three seconds
I wasted two hours reading the sox documentation and searching on the web for the format of some obscure fscking sound sample, and then finally came up with this. This plays only the first three seconds of your unknown formatted sound file using every one of sox's built-in filetypes. If you don't get an exact match, you may get close.
I could not fit every single type in and keep it under 127 characters, so you will have to replace "..." with the full list obtainable by `$ sox --help` (or try `Show sample output`)
note: /usr/bin/play should be linked to sox on most systems.
cat | perl -e '$/ = ""; $_ = <>; s///gs; print;'
remove comments from xml
xml with verbose commenting can be difficult to read. remove comments from xml.
grep -Ir foo *
recursive grep of text files
short command to find a string in all text files in all subdirectories, excluding all files grep does not deem text files.
ssh-keygen -G /tmp/moduli-2048.candidates -b 2048
generate the moduli file for openssh if lost
if you lost your moduli file in openssh server side you need generate new one with this command then test if the number generated can be used with ssh-keygen -T moduli-2048 -f /tmp/moduli-2048.candidates
function expand_url() { curl -sI $1 | grep Location: | cut -d " " -f 2 | tr -d "\n" | pbcopy }
OSX Expand URL and Copy to Clipboard
Expand a URL, aka do a head request, and get the URL. Copy this value to clipboard.
alias ip4rev "echo \!* | sed 's/^\([0-9]*\)\.\([0-9]*\)\.\([0-9]*\)\.\([0-9]*\)/\4.\3.\2.\1/'"
% ip4rev '192.0.2.34'
34.2.0.192
% dig +sh a `ip4rev 127.0.0.2`.zen.spamhaus.org.
127.0.0.2
127.0.0.4
127.0.0.10
(tcsh alias)Reverse an IPv4 address. It is useful to looking the address up in DNSBL.
For 'bash'
function ip4rev() { echo $@ | sed 's/^\([0-9]*\)\.\([0-9]*\)\.\([0-9]*\)\.\([0-9]*\)/\4.\3.\2.\1/'; }
svn st | grep '^\?' | awk '{print $2}' | xargs svn add; svn st | grep '^\!' | awk '{print $2}' | xargs svn rm
automatically add and remove files in subversion
automatically add and remove files in subversion so that you don't have to do it through the annoying svn commands anymore
lsof -i -n -P | grep :80
what?s running on a given port on your machine?
sudo find /etc/rc{1..5}.d -name S99myservice -type l -exec sh -c 'NEWFN=`echo {} | sed 's/S99/K99/'` ; mv -v {} $NEWFN' \;
`/etc/rc2.d/S99myservice' -> `/etc/rc2.d/K99myservice'
`/etc/rc3.d/S99myservice' -> `/etc/rc3.d/K99myservice'
Functions: find mv sed sh sudo
Manage "legacy" service run control links
Change run control links from start "S" to stop "K" (kill) for whatever run levels in curly braces for a service called "myservice". NEWFN variable is for the new filename stored in the in-line shell. Use different list of run levels (rc*.d, rc{1,3,5}.d, etc.) and/or swap S with K in the command to change function of run control links.
2>/dev/null dd if=/dev/urandom bs=1 count=6 | od -t x1|sed '2d;s/0000000 *//;s/ /:/g;s/::*$//'
dd:09:83:5f:9b:9d
Mac OS X needs some clean up. First command works in Linux, Solaris just needs the "0000000"'s removed
grep 'model\|MHz' /proc/cpuinfo |tail -n 2
model name : AMD Phenom(tm) II X4 965 Processor
cpu MHz : 3400.000
Information for only one core.
find -type f | xargs -I{} du -sk "{}" | sort -rn | head
Functions: du find sort xargs
Show the top 10 file size
ps -o comm= -p $$
First version was "ps uw -p $$", but current "ps -o comm= -p $$" just gives shell name
lxc-ls | sort -u | xargs -i sudo lxc-info -n {}
'lenny-pkg' is STOPPED
'lenny-www' is RUNNING
'squeeze-partial-pkg' is STOPPED
'squeeze-pkg' is RUNNING
Functions: sort sudo xargs
Get status of LXC
This short snippet outputs the state of all containers available on your system. It is quite helpful to see which ones are running and which are stopped. Please notice that the "sort -u" is needed, otherwise running containers will be reported twice (see output of "lxc-ls" on its own for why)
sed -n 's/[ :]/_/g; s/^\(.\{1,\}\)_5_\($1$[$./0-9A-Za-z]\{27,31\}\)_*$/\1:\2/p' < cisco-device-config > passwd
Format a password file for John the Ripper from Cisco configs (Level 5)
Pulled from http://www.openwall.com/lists/john-users/2006/05/14/8
/etc/security/bsmconv
Enable Basic Security Mode (BSM) Auditing --Solaris
Once Enabled this command enables a trail of all processes on the system. As the name suggested auditing for Solaris machines.
BSM creates a number of files in the /etc/security directory.
concatenate local RSA to remote machine's authorized_keys
cat ~/.ssh/id_rsa.pub | ssh user@site.com "cat - >> ~/.ssh/authorized_keys"
You'll want to use this for passwordless logins. Same as ssh-copy-id, if you don't have it on your system.
‹ First < 222 223 224 225 226 > Last ›
x0vnc4server -display :0 -PasswordFile ~/.vnc/passwd
Start a vnc session on the currently running X session
curl -o id.gif `date +http://d.yimg.com/a/p/uc/%Y%m%d/largeimagecrwiz%y%m%d.gif`
get daily wizard of id comic
Requires the date command. This also works with some other comics. Here's a bash script that displays daily Garfield, Id, and Andy Capp:
http://putnamhill.net/cgi-bin/yahoo-comics.sh?ga,crwiz,crcap
vsqlplus "SELECT * FROM TABLE_NAME;"
$function vsqlplus(){ cn=0; ROWNUM=-2; sqlplus -s USER/PASSWORD@DATABASE < <(echo -e "set colsep \"'\"\nset timing off\nset feedback off\nset lines 32676\nset pages 8000\n$1";) | sed "/^$/d" | tr -d '\t' | tr -s ' ' | while read cols; do ((++ROWNUM == -1)) && eval "array_cols=( $(echo ${cols} | tr \' ' ') )"; (( ROWNUM > 0 )) && ( echo "ROWNUM=$ROWNUM"; for (( c = 0; c < ${#array_cols[*]}; c++ )); do echo " ${array_cols[(c) % ${#array_cols[*]}]}=\"$(echo "$cols"|cut -d\' -f$((c+1)) )\""; done; ) done; }; vsqlplus "SELECT * FROM TABLE_NAME;";
ROWNUM=1
COLUMN_1=[COLUMN_1_VALUE]
COLUMN_2=[COLUMN_2_VALUE]
COLUMN_3=[COLUMN_3_VALUE]
ROWNUM=2
get the result of database query in vertical way (Column=Value)
the database client sqlplus generate results one line per row.
This function convert the sqlplus output to show the result vertically, in layout:
Column_name=[Column_Value].
Very usefull for scripts.
for arptable in `arp | grep "eth1" | cut -d " " -f1`; do arp -d $arptable; done
Functions: arp cut grep
Clear ARP table in linux.
Clears the "arp" table, without entering manually addresses (tested in Ubuntu).
find -type f | xargs -I{} du -s "{}" | sort -rn | head | cut -f2 | xargs -I{} du -sh "{}"
Functions: cut du find head sort xargs
Show the top file size in human readable form
rmall_but() { declare -A keep;for arg;do keep[${arg%/}]=1;done;for file in *;do [[ ${keep[$file]} ]] || rm -rf "$file";done; }
rany:~/Desktop$ ls
f1 f2 f3 f4
rany:~/Desktop$ rmall_but f1 f4
f1 f4
Using associative array to remove all files and directories under PWD except "$1", "$2", "$3",..."$n"
alias cps="ps -u root U `whoami` --forest -o pid,stat,tty,user,command |ccze -m ansi"
Tree based ps view "painted" by ccze
find . -regex ".*\.[cChH]\(pp\)?" -print | etags -
Functions: etags find
Create etags file of .c, .cpp, and .h files in all subdirectories
The regular expression matches patterns of .c, .cpp, .C, .Cpp, .h, .hpp, .H, .Hpp. The matched files are piped through etags to create a TAGS file, useful for emacs. Alternate regex (if you aren't worried about capital .Cpp) is -regex ".*\.c\|.*\.cpp\|.*\.h"
for x in `jot - 0 \`curl "http://www.commandlinefu.com/commands/browse"|grep "Terminal - All commands" |perl -pe 's/.+(\d+),(\d+).+/$1$2/'|head -n1\` 25`; do curl "http://www.commandlinefu.com/commands/browse/sort-by-votes/plaintext/$x" ; done >a.txt
# SSH connection through host in the middle
ssh -t reachable_host ssh unreachable_host
# A fun thing to do with ram is actually open it up and take a peek. This command will show you all the string (plain text) values in ram
sudo dd if=/dev/mem | cat | strings
# Watch Star Wars via telnet
telnet towel.blinkenlights.nl
# Backticks are evil
echo "The date is: $(date +%D)"
This is an extension of a previous command by satyavvd on 2009-07-23 12:04:02, but this one grabs the whole archive. Hard coded numbers in previous script capped number of commands that could be fetched. This one grabs them all regardless of how big the archive gets.
shutdown -r now
orderly shutdown system and reboot.
Good practice to use "shutdown -r now" instead of reboot.
watch -n 2 netstat -antu
Functions: netstat watch
Watch netstat output every 2 seconds
[ "c84fa6b830e38ee8a551df61172d53d7" = "$(md5sum myfile | cut -d' ' -f1)" ] && echo OK || echo FAIL
wcalc -q <<< '3/5'
0.6
Calculator for shell. Similar performance and basic usage as 'bc', but with more advanced features. Not installed on most systems by default.
grep -i "$*" /usr/lib/perl5/Unicode/CharName.pm | while read a b; do /usr/bin/printf "\u$a\tU+%s\t%s\n" "$b"; done
No need for further filedes or substitution for splitting. Simply use read a b
setxkbmap -layout us,ru -variant basic,phonetic -option -option grp:switch,grp:caps_toggle
For setting of double keyboard layouts: us, ru, but you can write in phonetic like www.translit.ru
test -d folder || mkdir folder
Functions: mkdir test
Create a folder but first you can test if it exists
cat video.avi.001 video.avi.002 video.avi.003 >> video.avi
Combining video file part downloaded separately using cat command
c=blue;convert -size 50x50 xc:$c $c.png; for i in red green yellow; do convert $c.png -background $i -rotate 20 $i.png; rm $c".png"; c=$i; done; mv $i".png" logo.png; display logo.png
Functions: mv rm
create a colorful image
dig +noall +answer exsample.com
print only answer section.
for x in `git status | grep deleted | awk '{print $3}'`; do git rm $x; done
Functions: awk grep rm
date -d 09/20/1981 +"%Y-%m-%d"
Change date from MM/DD/YYYY to YYYY-MM-DD (mysql like)
alias chop="tr -d '\r\n'"
bash chop
similar to perl chop()
svn diff ARGUMENTS_FOR_DIFF | source-highlight --out-format=esc --src-lang=diff
wget -O - -q http://www.azlyrics.com/lyrics/abba/takeachanceonme.html | sed -e 's/[cC]hance/dump/g' > ~/tdom.htm && firefox ~/tdom.htm
Make ABBA better (requires firefox)
ABBA would be more entertaining if they sang this.
for i in in $(vgdisplay -v vg00 | grep "LV Name" | awk '{ print $3 };'); do; lvextend -m 1 $i /dev/disk/; done
Create one mirror copy of every lvol in the vg00 just after a cold install of an HP-UX 11.31. Cna be used also for 11.23 but remember that in 11iv2 there is no agile view so the disk will be /dev/dsk/cxtxdxs2
‹ First < 223 224 225 226 227 > Last ›
sed 's+href="\([^"]*\)"+\n\1\n+g' bookmarks.html | grep '^http' |clive
Parse bookmarks and download youtube files
Parses your exported bookmarks to generate a clean list of http lines and passes it on to clive to try to download the video file from various sites.
__disown(){ local cmd=$1 ; shift ; $cmd "$@" &> /dev/null &disown }; for i in gvim ; do alias $i="__disown $i"; done
Functions: alias shift
gvim foo.txt
will open gvim dettached from the current terminal.
netstat -tlvp
find out which TCP ports are listening and opened by which process in verbose
MAC=$((date +'%Y%m%d%H%M%S%N'; cat /proc/interrupts) | md5sum | sed -r 's/(..)/\1:/g' | cut -d: -f 1-6)
Functions: cat cut date md5sum sed
I liked vaporub's suggestion, here a little simplification of the sed command.
cat file.orig | ssh user1@host1 "ssh user2@host2 \"ssh user3@server3 'cat >file.dest'\""
Copy a file over the network with 3 bounces
pub key in ./ssh/authorized_keys needed because ssh-ed ssh can't ask for the password.
cat file.txt | while read line; do printf "%7.2f -> %7.2f\n" $line; done
Functions: cat printf read
Bashbuiltin printf
ifconfig -a| awk 'BEGIN{FS="[ :]+"} /Bcast/{print $4}'
Return IP Address
curl -s -L --head -w "%{http_code}\n" URL | tail -n1
Get the state (HTTP code) of a resource from its URL
find . -type f -name '*.jpg' -exec convert -quality 75 {} {} \;
Converts all jpg files to 75 quality.
Requires ImageMagick to be installed.
This command was stolen from @climagic on Twitter.
Probably a duplicate of command below, but this command uses slightly higher quality.
http://www.commandlinefu.com/commands/view/707/compress-images-using-convert-imagemagick-in-a-bulk
du -sh `pwd`
235M /home/user/files1
Show size of in MB of the current directory.
Shows the size of the directory the command is ran in.
The size is in MB and GB.
There is no need to type the path, its the current working directory.
git merge --no-commit --no-ff
git merge --dry-run
Will do the merge, but only apply changes to working copy and index; won't commit.
for x in `seq -w 1 30`; do sar -b -f /var/log/sa/sa$x | gawk '/Average/ {print $2}'; done
4789.98
4286.45
4286.23
4028.34
4108.42
812.15
3171.27
3696.37
4584.12
Extract the daily average number of iops
You need sysstat and gawk for this to work.
vim -e -s -c 'g/start_pattern/+1,/stop_pattern/-1 p' -cq file.txt
$cat file.txt
begin
here too
start_pattern
pipo
et
molo
du
ski
stop_pattern
plus
more
here
$vim -e -s -c 'g/start_pattern/+1,/stop_pattern/-1 p' -cq file.txt
By using vim, you can also filter content on stdout, using vim's extra power, like search pattern offset!
No more awk of course, sorry.
details :
-e ex mode
-s silent
-c 'ex command' : global + start and end pattern + offset print (p)
-cq : quit
function wherepath () { for DIR in `echo $PATH | tr ":" "\n" | awk '!x[$0]++ {print $0}'`; do ls ${DIR}/$1 2>/dev/null; done }
$ PATH=/opt/freeware/bin:/usr/bin:/usr/bin:/usr/bin:/usr/local/bin:/usr/sbin:$HOME/bin:/opt/freeware/bin:$HOME/bin
$ wherepath awk
/opt/freeware/bin/awk
/usr/bin/awk
/home/user/bin/awk
Functions: awk ls tr
list all instances of a file in your PATH directories (without duplicates) in PATH order
The wherepath function will search all the directories in your PATH and print a unique list of locations in the order they are first found in the PATH. (PATH often has redundant entries.) It will automatically use your 'ls' alias if you have one or you can hardcode your favorite 'ls' options in the function to get a long listing or color output for example.
Alternatives:
'whereis' only searches certain fixed locations.
'which -a' searches all the directories in your path but prints duplicates.
'locate' is great but isn't installed everywhere (and it's often too verbose).
ps -eo pmem,pid,comm --no-headers | sort -k1 -rn | head -10
8.2 14730 MATLAB
5.6 2236 nautilus
3.1 1 chromium-browse
2.7 2555 chromium-browse
24.7 1 dropbox
1.8 2555 chromium-browse
1.4 2550 chromium-browse
1.2 2555 chromium-browse
show top 10 most memory hungry process with a simple format of (%mem, pid, short command)
Pros: the format is very simple, there is no need to show every columns, and full command with args
the first column is memory consumption %
the second column is pid
the third is just the command (without full arguments, most application's arguments are too long)
You can decide which application to kill then.
cat /etc/passwd | wc -l
Functions: cat wc
How many lines does the passwd file have?
rsync -aHux --exclude=/proc/* --exclude=/sys/* /* /mnt/target/
cloning root filesystem without suffering to possible interruptions. useful when moving a running system to a new partition. also works as a solid backup solution.
nmap -T Aggressive -A -v 127.0.0.1 -p 1-65000
List services running on each open port
git merge-base branch1 branch2
ee474386d98836f33fc6138f7ef8894d3f5ff2fd
git branch point
Tells the closest (latest) shared ancestor commit (SHA1) of two branches.
http://www.kernel.org/pub/software/scm/git/docs/git-merge-base.html
defaults write com.apple.Finder AppleShowAllFiles TRUE
Show hidden files in OS X
Swap TRUE with FALSE to turn it off again. Note: Finder must be relaunched afterwards to see the effect. For example like this:
killall Finder && open /System/Library/CoreServices/Finder.app
do-release-upgrade
do a release upgrade in ubuntu
release upgrades are major upgrades as from 8.04 to 8.10 or from 8.10 to 9.04
update-manager-core must be installed:
sudo apt-get install update-manager-core
in some cases you must edit '/etc/update-manager/release-upgrades' and set 'Prompt=normal'
echo "1+1" | bc
calculate in commandline with bc
function clearIptables(){iptables -P INPUT ACCEPT; iptables -P FORWARD ACCEPT; iptables -P OUTPUT ACCEPT; iptables -F; iptables -X; iptables -L}
Clear iptables rules safely
ur1() { curl -s --url http://ur1.ca/ -d longurl="$1" | sed -n -e '/Your ur1/!d;s/.*.*$/\1/;p' ; }
Short URLs with ur1.ca
ur1.ca needs http:// on your URL
echo "LINUX,DIR,FILE1,FILE2,FILE3" | perl -aF, -nle 'my ($fld1, $fld2, @fields) = @F; while(@fields) { print join ",", $fld1, $fld2, splice(@fields, 0, 1) }'
LINUX,DIR,FILE1
LINUX,DIR,FILE2
LINUX,DIR,FILE3
Functions: echo join perl
Print repeating CSV values on new lines - normalize repeating fields
Lets say you have a file with the following layout:
LINUX,DIR,FILE1,FILE2,FILE3
You want the file to look like this:
LINUX,DIR,FILE1
LINUX,DIR,FILE2
LINUX,DIR,FILE3
This perl command does it for you.
‹ First < 224 225 226 227 228 > Last ›
dir -C -1 -N -RNCCI /dir/ > file.csv
Functions: dir
Print file list to CSV
find /path/to/dir -user root -exec chown [nonprivuser] {} \;
For files owned by root only, change ownership to a non-privileged user.
useful if you want to start running a svc as a non-privileged user instead of root.
cvs -n update 2>null | grep -i "M " | sed s/"M "//
Functions: cvs grep sed
tty > /dev/null 2>&1 || { aplay error.wav ; exit 1 ;}
Functions: aplay exit tty
If your script needs to be run in a terminal, this line at the top will stop it running if you absent-mindedly double-click the icon, perhaps intending to edit it. (Of course this won't help with scripts that run in the background.)
dc -e "1 1 + p"
calculate in commandline with dc
Us dc instead of bc. RPN FTW!!!
rm -rf .??*
[root@centos CRM]# ls -al
drwxrwxr-x 3 gregg gregg 4096 Mar 10 22:59 .
drwxr-xr-x 29 gregg gregg 4096 Mar 10 22:59 ..
-rw-rw-r-- 1 gregg gregg 146 Nov 25 2008 .htaccess
drwxrwxr-x 6 gregg gregg 4096 Nov 24 2008 .svn
[root@centos CRM]# mv .??* ../
drwxrwxr-x 2 gregg gregg 4096 Mar 10 22:59 .
drwxr-xr-x 30 gregg gregg 4096 Mar 10 22:59 ..
rm -rf .* matches ".." and thus one goes up a level and wipes out more than intended.
In bash, .??* safely accomplishes what one intends - remove those .files
The ? matches most characters except "/", thus .?? does not match ../ and so one is safe.
find $PWD -type d | while read "D"; do cd "$D"; for filename in *.epub;do ebook-convert "$filename" "${filename%.epub}.mobi" --prefer-author-sort --output-profile=kindle --linearize-tables --smarten-punctuation --asciiize;done ;done
Functions: cd find read
Recursive script to find all epubs in the current dir and subs, then convert to mobi using calibre's ebook-convert utility
finds all epub files in the current directory and all child directories and converts them to .mobi format.
all of the ebook-convert -options are optional; the only parameters you are required to pass are the incoming file and the outgoing file, with the extension.
egrep expr1\|expr2 file
Regex or
SCALE=3; WIDTHL=10; WIDTHR=60; BAR="12345678"; BAR="${BAR//?/==========}"; while read LEFT RIGHT rest ; do RIGHT=$((RIGHT/SCALE)); printf "%${WIDTHL}s: %-${WIDTHR}s\n" "${LEFT:0:$WIDTHL}" "|${BAR:0:$RIGHT}*"; done < dataset.dat
$ cat dataset.dat
Beatrice 23
$ SCALE=1; WIDTHL=10; WIDTHR=60; BAR="12345678"; BAR="${BAR//?/==========}"; while read LEFT RIGHT rest ; do RIGHT=$((RIGHT/SCALE)); printf "%${WIDTHL}s: %-${WIDTHR}s\n" "${LEFT:0:$WIDTHL}" "|${BAR:0:$RIGHT}*"; done < dataset.dat
Andreas: |=========================================*
Beatrice: |=======================*
Functions: printf read
Print a bar graph
WIDTHL=10 and WIDTHR=60 are setting the widths of the left and the right column/bar. BAR="12345678" etc. is used to create a 80 char long string of "="s. I didn't know any shorter way.
If you want to pipe results into it, wrap the whole thing in ( ... )
I know that printing bar graphs can be done rather easily by other means. Here, I was looking for a Bash only variant.
chgrp -R [projgroup] ; find /path/to/dir -type d -exec chmod g+s {} \;
Functions: chgrp chmod find
Turn /path/to/dir and subdirectories into a project tree
changes group ownership of all files/dirs in /path/to/dir to a project group [projgroup] and then gives the sgid bit to directories in that tree - all subsequently created files will inherit [projgroup]'s gid.
alias showip="ifconfig eth0 | grep 'inet addr:' | sed 's/.*addr\:\(.*\) Bcast\:.*/\1/'"
$ showip
192.168.0.55
alias to show my own configured ip
parses the output of ifconfig to show only the configured ip address (in this case from interface eth0).
the regexp is quick'n'dirty im sure it can be done in a better way.
--> this alias does not show your "internet ip" when you're in a nat-environment
remind -z1 -k'echo %s |ssh @ "growlnotify"' ~/.reminders &
Send Reminders from your Linux Server to Growl on a Mac
Requires Linux Remind:
http://www.roaringpenguin.com/products/remind
and Growl on the Mac:
http://growl.info/
growlnotify needs to be in the executable path on the mac.
Combined with "prowl" in the iPhone you can receive push notifications of your reminders to the iPhone.
echo 50 > /proc/sys/vm/swappiness
rm -rf .[!.]*
convert -crop 32x33 +repage http://code.google.com/more/more-sprite.png icon.png
crop google's icons
convert -crop 51x34 +repage http://www.google.com/images/flags/sprite_flag-50.png flag.png
alias me="echo '`ifconfig | grep inet | grep broadcast | awk '{print $2}'`' && uname -n"
$ me
computer-host-name.local
10.0.1.5
get ip and hostname for this computer
Creates an alias that reports your hostname and IP for you computer. Getting the quotes in an alias with awk commands can be a painful. Need uname and ifconfig--both are included in most unix distributions, I believe. Hope it is useful.
find . -name ".svn" -exec rm -rf {} \;
If you need to delete all redundant ".svn" directories from a given path and all its subdirectories, use this command !
Particulary useful if you want to upload to an ftp server, but don't use svn or if you need to update/backup some source code to another directory.
You can also try "svn export . /new/path/without/svn/dirs" (also from the CLI)
less =rcsyslog
opening your helper script without knowing the path (zsh)
This is equivalent to: less `which rcsyslog`
cp -arv ~/Documents/{foo,bar} --target-directory=~/buzz/
Copy the directory you want to specify a comma separated list of directories to copy.
ssh -c 'tar cvzf - -C /path/to/src/*' | tar xzf -
Create & transfer tarball over ssh
Create tarball on stdout which is piped to tar reading from stdin all over ssh
!xclip -i %
Allows to copy the file contents to X clipboard, and then be pasted in any application with the middle mouse button.
sudo cpulimit -e Grooveshark -l 20
Process 2927 detected
Stop Grooveshark destroying your CPU
Will limit the amount of CPU time Grooveshark the greedy yet useful Adobe Air app will have.
Leaves the UI lagging a little, but crucially does not ruin the audio.
fortune | pv -qL 10
type fortune in real time
vzlist -a -H -o hostname,diskspace,diskspace.s,veid | awk '{ printf( "%2.f%\t%s\t%s\n"), $2*100/$3, $4, $1}' | sort -r
Get disk quota usage openvz using vzlist
OpenVZ: Get disk quota usage for your VEID
sort -t"," -n -k5 file.csv # according to the 5th field NUMERICALLY!!
pielberg,Steven,18,dec,1946
Gellar,Sarah_Michelle,14,apr,1977
Bryant,Kobe1,23,aug,1978
Bryant,Kobe4,23,sep,1979
Harnois,Elisabeth,26,may,1979
Underwood,Carrie,10,mar,1983
Ryan,Michelle,22,apr,1984
Belle,Camilla,2,oct,1986
Sharapova,Maria,19,apr,1987
Bryant,Kobe3,23,sep,1998
Bryant,Kobe2,24,aug,2000
the file.csv is:
sort a csv file according to a particular n th field numerically (quicker than excel)
-n is very important, otherwise it's string comparison
‹ First < 225 226 227 228 229 > Last ›
$ history
convert input.png -mattecolor gold -frame 10x10+5+5 output.png
add border to image
/sbin/dumpe2fs /dev/hda2 | grep 'Block size'
How to Find the Block Size
Useful to know, especially if you are dealing with output configurations in block size.
Tested on 'Red Hat'.
ssh middlehost "ssh -a root@securehost '> nicescript'" < nicescript
Stop tormenting the poor animal cat!
Also you should not that you need a private key not protected by a passphrase on middlehost that grants you access to securehost..
awk 'NR==2 {print $1}' /proc/net/arp
netstat -tulpnc
tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:6010 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:6011 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:6012 0.0.0.0:* LISTEN -
tcp 0 0 :::111 :::* LISTEN -
tcp 0 0 :::22 :::* LISTEN -
tcp 0 0 ::1:631 :::* LISTEN -
tcp 0 0 ::1:25 :::* LISTEN -
tcp 0 0 ::1:6010 :::* LISTEN -
tcp 0 0 ::1:6011 :::* LISTEN -
tcp 0 0 ::1:6012 :::* LISTEN -
udp 0 0 0.0.0.0:111 0.0.0.0:* -
udp 0 0 0.0.0.0:631 0.0.0.0:* -
udp 0 0 0.0.0.0:670 0.0.0.0:* -
udp 0 0 0.0.0.0:26791 0.0.0.0:* -
udp 0 0 0.0.0.0:5353 0.0.0.0:* -
udp 0 0 0.0.0.0:39640 0.0.0.0:* -
udp 0 0 :::111 :::* -
udp 0 0 :::546 :::* -
udp 0 0 :::670 :::* -
udp 0 0 :::43339 :::* -
(Not all processes could be identified, non-owned process info
will not be shown, you would have to be root to see it all.)
showing opened ports on machine
shows opened ports on machine in continuous mode (refreshing every 10 sec)
svn log | tr -d '\n' | sed -E 's/-{2,}/\'$'\n/g' | sed -E 's/ \([^\)]+\)//g' | sed -E 's/^r//' | sed -E "s/[0-9]+ lines?//g" | sort -g
SVN Status log to CSV (Mac OSX friendly)
This is a minor variation to cowboy's submission - his script worked great on Ubuntu, but the sed gave issues on osx (which used BSD). Minor tweaks (sed -E instead of sed -r and \'$'\n to handle the new line made it work.
convert input.png -shave 10x10 output.png
remove border of image
pacman -Q | grep -v pacman | cut -d' ' -f1 > packages.txt && pacman -Sy `cat packages.txt` --noconfirm
pacman install list of packages
mplayer -vo aa:eight:driver=curses video.avi >video.txt
.......MMMMMMMMMMMMMMM????+????I???. MMMMMMMMMMMMMNOOODMM7??+MMMMMMMMMMMMM.
..8??????777MMMMMMMMMMMMM????????M??+MMMMMMMMMMDOOOOOOOOOOMMI????MMMMMMMMMMMN
M??????++?I777MMMMMMMMMMMMMMNMM7?7+?+MMMMMMMMM8OOOOOOOOO8MMMMO????+DMMMMMMMMM
7+M8I???????7777MMMMMMMMMMMMMMMMM??8??MMMMMMMMMOOOOOODMMMMMMMMMMMOMN+7MMMMMMMM
.I????????????7777DMMMMMMMMMMMMMMM??I??8MMMMMMMMOOOOOOOMMMMMMMMMMNOM???MMMMMMMM.
D+??????$ZO$??I7777MMMMMMMMMMMMMMM7+?M?IMMMMMMMOOOOOOOOMMMMMMMMMMN$???7MMMMMMMM7
M???M$?????????77777MMMMMMMMMMMMMMM??+D+?Z..MMMOOOOOOOOMMMMMM8 7????+MMMMMMMM8I
. ZM???????????I77777MMMMMMMMMMMMMM???+$+?IIZ=....DN.:NZ8 ...M?????IMMMMMMMM?
.D????????????77777MMMMMMMMMMMMMM+????8??????$MD:......7M7???????OMMMMMMMM=
..MMMMMMM?????77777NMMMMMMMMMMMM 8?????D+??????????????????????+D. MMMM=~~
converts video to ascii art (txt) by mplayer and aa|caca lib
Great for telnet stream. Substitute aa with caca for colour. To see in terminal:
cat video.txt
sleep 3m; play bigben.wav
teatimer
plays wave file after 3 minutes
ps -ec -o command,rss | grep Stainless | awk -F ' ' '{ x = x + $2 } END { print x/(1024) " MB."}'
638.469 MB
Sum of the total resident memory Stainless.app is using.
Adds up the total memory used by all Stainless processes: 1 Stainless, 1 StainlessManager and 1 StainlessClient per tab open.
youtitle(){ GET $1 | grep document.title | sed "s;^.*document.title = '\(.*\)'.*$;\1;"; };
youtitle "http://www.youtube.com/watch?v=Bs-myQ-ZqmE&feature=related"
YouTube - Perplexer - Acid Folk
Get the title of a youtube video
CMD="who";SEC=1;N=0;OLD="";NEW=""; while `sleep $SEC`; do OLD="$NEW"; NEW="$(eval $CMD)"; DIFF=`diff <( echo "$OLD" ) <( echo "$NEW" )`; if [ -n "$DIFF" ]; then date; echo "Diff #$N (${SEC}s): $CMD"; echo "$DIFF"; fi; N=$[$N+1]; done | tee /tmp/keepr
Mon Dec 25 14:15:30 EST 2099
Diff #0 (1s): who
1c1
<
Mon Dec 25 14:15:32 EST 2099
Diff #4 (1s): who
1a2
Mon Dec 25 14:20:37 EST 2099
Diff #11 (1s): who
Watch and keep history of a command
Watch any command (pipes ok, quotes be careful) and keep history in a file. Good for watching and recording any kind of status or error condition, file creations, etc. The choice of "who" as CMD was just to show an obvious usage.
Uses plenty of shell tricks that can be disassembled for simpler stuff. It's deliberately not perfect, but it is generic, and can be customized for your own uses. Had to shorten a little to meet 255 chars.
Better than "watch" how? It keeps a date log of what is going on, and tee'd output is plain-text.
montage *.png -mode concatenate -tile 10x all.png
create a image matrix
date -u +%W$(uname)|sha256sum|sed 's/\W//g'
Functions: date sed
anti-spam
defaults write com.apple.dashboard mcx-disabled -boolean YES; killall Dock
gzip -dc /tmp/pavanlimo.gz | psql -U user db
Run gunzipped sql file in PostGres, adding to the library since I couldnt find this command anywhere else on the web.
perl -e '$_=`ifconfig eth0`;/\d+.\d+.\d+.\d+ /; print $&,"\n";'
10.10.10.10
If you are interested in interfaces other than eth0 you will need to change eth0 to your interface name.
You could use this mammoth to nab the ip4 addresses of all your interfaces
perl -e '@_=`ifconfig -a`; sort(@_); foreach(@_) { /(inet addr\:)(\d+.\d+.\d+.\d+ )/; $_=$2; @uniq=grep($_ ne $prev && (($prev) = $_), @_);} print join "\n",@uniq,"\n"; '
it seems silly to have all this code when the following will work fine
ifconfig -a | grep "inet " | awk -F":" ' { print $2 } ' | cut -d " " -f1
find . -type f -newer 201011151300.txt -exec head -1 {} \;
hello this is file one line 1
hello this is file two line 1
Functions: find head
print the first line of every file which is newer than a certain date and in the current directory
create the "newer than" file by:
touch -t 201011151300 ./201011151300.txt
the format for the time is
[[CC]YY]MMDDhhmm[.SS]
digest -a -v md5
user@computer: digest -v -a md5 /tmp/testfile
md5 (/tmp/testfile) = 485946e6a7217e137ae32f81016fe53a
md5 checksum check
$sudo aptitude install python-virtualenv; virtualenv --no-site-packages jpaenv; source jpaenv/bin/activate
Python virtual-env creation
Python virtual environment creation.
wget -O chart.png 'http://chart.googleapis.com/chart?chs=250x100&chd=t:60,40&cht=p3&chl=Hello|World'
google chart api
http://chart.apis.google.com/chart?chs=450x200&cht=p3&chtt=Browser+Usage+on+Wikimedia&chl=IE%2834.2%%29|Firefox%2823.6%%29|Chrome%2820.6%%29|Safari%2811.2%%29|Opera%285.0%%29|Android%281.9%%29|Other%283.5%%29&chd=t:34.2,23.6,20.6,11.2,5.0,1.9,3.5
nano `which script`
Edit any script executable by the user.
Substitute nano with your favorite editor, of course.
for x in `ptree | awk '{print $1}'`; do pfiles $x | grep ${PORT} > /dev/null 2>&1; if [ x"$?" == "x0" ]; then ps -ef | grep $x | grep -v grep; fi; done 2> /dev/null
root@shell02:~# for x in `ptree | awk '{print $1}'`; do pfiles $x | grep -w ${PORT} > /dev/null 2>&1; if [ x"$?" == "x0" ]; then ps -ef | grep $x | grep -v grep; fi; done 2> /dev/null
root 5386 5331 0 Oct 06 ? 1:29 /lib/svc/bin/svc.configd
root 6211 6209 0 Oct 06 ? 0:02 /usr/lib/autofs/automountd
root 17437 6425 0 09:02:56 ? 0:00 /usr/lib/ssh/sshd
daemon 12227 5331 0 Dec 03 ? 0:00 /usr/lib/nfs/statd
daemon 12232 5331 0 Dec 03 ? 0:00 /usr/lib/nfs/lockd
root@shell02:~#
Can use lsof, but since it's not part of the base OS, it's not always available.
‹ First < 226 227 228 229 230 > Last ›
hostresult=$(host -t A www.example.com); echo "${hostresult##* }"
192.0.32.10
The host command comes with the bind-utils package, which is has a better chance to be installed than resolveip from mysql. The last word of the query result is displayed, which is the last result host got.
This works with CNAMEs.
You get "3(NXDOMAIN)" in case of failure.
(IFS=$'\n'; ln -sf $(awk '((NR % 2) != 0 && NR > 1) {print "prefix" $0}' list.m3u) target_folder)
Functions: awk ln
Populate a folder with symbolic links to files listed in an m3u playlist.
This command will place symbolic links to files listed in an m3u playlist into a specified folder. Useful for uploading playlists to Google Music.
prefix = The full path prefix to file entries in your .m3u file, if the file paths are relative. For example, if you have "Music/folder/song.mp3" in your list.m3u, you might want to specify "/home/username" as your prefix.
list.m3u = Path to the playlist
target_folder = Path to the target folder in which you would like to create symlinks
find $SDIR -name '${f}.*' -mtime +$n -maxdepth 1 | xargs -n 10 rm -vf
find something
sudo date -s "26 OCT 2008 19:30:00"
Set date and time
find . -iname ".project"| xargs -I {} dirname {} | LC_ALL=C xargs -I {} svn info {} | grep "Last Changed Rev\|Path" | sed "s/Last Changed Rev: /;/" | sed "s/Path: //" | sed '$!N;s/\n//'
Project1/foo;123
Project1/bar;321
Project2/foobar;213
Functions: dirname find grep info sed xargs
Get last changed revision to all eclipse projects in a SVN working copy
Searches for all .project files in current folder and below and uses "svn info" to get the last changed revision. The last sed joins every two lines.
perl -e 'system @ARGV, ' ssh host -l user < cmd.txt
Functions: host perl ssh
I was tired of the endless quoting, unquoting, re-quoting, and escaping characters that left me with working, but barely comprehensible shell one-liners. It can be really frustrating, especially if the local and remote shells differ and have their own escaping and quoting rules. I decided to try a different approach and ended up with this.
exec 3<&0; ls -1N | while read a; do echo "Rename file: $a"; read -e -i "$a" -p "To: " b <&3 ; [ "$a" == "$b" ] || mv -vi "$a" "$b"; done
Rename file: 1one
To: 1one.txt
`1one' -> `1one.txt'
Rename file: 2two
To: one plus one
`2two' -> `one plus one'
Rename file: 3three
To: 3three
Rename file: 4four
To: 2 x 2
`4four' -> `2 x 2'
Rename file: 5five
To: 5five.avi
`5five' -> `5five.avi'
Functions: echo exec ls mv read
Rename files in a directory in an edited list fashion
just an alternative to #7818
find . -name '*.epub' -exec sh -c 'a={}; ebook-convert $a ${a%.epub}.mobi --still --more --options' \;
Functions: find sh
-exec sh -c 'var={}; do something with var' lets you do things in a sub-shell
while it's faster to type, I'm not sure if dozens of subshells execute quicker than the while loops.
echo $(grep "^[^']\{3,5\}$" /usr/share/dict/words|shuf -n4)
potty Aspen seedy curt
The improvement of this command over Strawp's original alternative is that you can specify the size of the words, in this particular case words between 3 and 5 character's long. It also excludes words that contain apostrophes, if you'd rather keep those words simply substitue [^'] for .
///bin/true; exec java bsh.Interpreter "$0" "$@"
(Inside of a shell script) Make executable a BeanShell script under Linux/Cygwin
The two lines below are for a BeanShell script so it can be executed under Linux and Cygwin. Also, bsh.jar must be in the CLASSPATH environment variable, or in the jre/lib/ext/ directory of the JVM.
#! /bin/sh
find start_dir -name *.txt | xargs -J % cp % end_dir/
catch all the txt files into a start_dir tree and copy them into a single end_dir
ls -1 *.jpg | while read fn; do export pa=`exiv2 "$fn" | grep timestamp | awk '{ print $4 " " $5 ".jpg"}' | tr ":" "-"`; mv "$fn" "$pa"; done
2008-09-26 20-59-03.jpg 2008-10-25 22-27-45.jpg 2008-12-19 22-07-51.jpg
2008-10-02 15-01-42.jpg 2008-10-25 22-28-02.jpg 2008-12-19 22-07-59.jpg
2008-10-02 15-25-34.jpg 2008-11-04 16-44-20.jpg 2008-12-19 22-09-54.jpg
Functions: awk export grep ls mv read tr
Renames all the jpg files as their timestamps with ".jpg" extension.
rfkill block bluetooth
Turns off the bluetooth hardware module. To turn it back on use `rfkill unblock bluetooth`. Works in Ubuntu, probably in other distros as well. I don't know if you need some special user permission to do this. It worked for me out of the box.
ifconfig eth3|sed 's/^eth3.*HWaddr //;q'
00:50:56:BC:92:0A
Reading my nic's mac address
Just replace eth3 with the interface you want the MAC for.
v () { ( IFS=$'\n'; suf="_versions"; mkdir -p "$1$suf"; nr=`ls "$1$suf" | wc -l`; nr=`printf "%02d" $(($nr + 1))`; cp "$1" "$1$suf/v${nr}_$1" ) }
file.svg
file.svg_versions/v01_file.svg
file.svg_versions/v02_file.svg
Functions: cp mkdir wc
Quick and dirty version control for one file
Bash function copies a file prefixed with a version number to a subdirectory
convert input.png -colorspace Gray output.png
grayscale image
mtree -c -K sha256digest -X mtree.exclude -p /path > host.mtree
Generate a specification file for file integrity scanning.
find . -name '*.m4a' | xargs -I audiofile mplayer -ao pcm "audiofile" -ao pcm:file="audiofile.wav"
covert m4a audio files to wav
sed -n '//,/<\/Tag>/p' logfile.log
Extract XML from an otherwise plain text log file
If your XML is appended to a line with a time stamp or other leading text irrelevant to the XML, then you can append a s/foo/bar/ command, like this:
sed -n //,/<\/Tag>/p; s/.*\( Last ›
for f in $(qlist -IC); do stat /usr/portage/"$f" > /dev/null; done
stat: cannot stat `/usr/portage/virtual/ghostscript': No such file or directory
stat: cannot stat `/usr/portage/virtual/mpg123': No such file or directory
stat: cannot stat `/usr/portage/virtual/poppler': No such file or directory
Find installed packages that are not in the portage tree anymore.
Problem arises when ebuild gets removed from portage and you end up with old and unmaintained package that you cannot find standard way. This oneliner will give you list of those packages.
function focus() { winID=`xprop -root |awk '/_NET_ACTIVE_WINDOW/ {print $5; exit;}'`; $@; wmctrl -i -a $winID; }
Autofocus window after executing some command
focus make all
from: http://noisy-coder.blogspot.com/2010/10/autofocus-window.html
netstat -atn | perl -ane 'if ( $F[3] =~ /(\d+)$/ ) { $x{$1}=1 } END{ print( (grep {!$x{$_}} 32768..61000)[0] . "\n" )}'
Functions: grep netstat perl
perl-based version
shuf /usr/share/dict/words |grep "^[^']\{3,5\}$" |head -n4
nukes
waken
Liszt
vain
Functions: grep head
This does the same thing that the command 'j_melis' submitted, but does it a lot quicker.
That command takes 43 seconds to complete on my system, while the command I submitted takes 6 seconds.
netstat -antuwp | egrep "(^[^t])|(^tcp.*LISTEN)"
Functions: egrep netstat
Lists open ports
grep -v "^\W$"
Match non-empty lines
I had some trouble removing empty lines from a file (perhaps due to utf-8, as it's the source of all evil), \W did the trick eventually.
ulimit -n
Change open file descriptors limit.
It is not uncommon to receive an error "Too many open files", this command allows you to change the limit for a user. This can be put into /etc/profile so that all users will have this change.
iptables -L -n -v
View firewall config including devices on linux w/netfilter
I was previously unaware of the -v switch. As a result I never got specifics about which interfaces the allowed or dropped applied to. Thought I'd share the wealth...
FYI, -n prevents DNS resolving of IPs.
wget -q $(lynx --dump 'http://geekandpoke.typepad.com/' | grep '\/.a\/' | grep '\-pi' | head -n 1 | awk '{print $2}') -O geekandpoke.jpg
Functions: awk grep head wget
Get the latest Geek and Poke comic
detex document.tex|wc -w
Count words in a TeX/LaTeX document.
x=(*.001); cat "${x%.001}."* > "${x%.001}" #unsafe; does not check that all the parts are there, or that the file-sizes make sense!
Functions: cat make
Join all sequentially named files in the directory
Join all sequentially named files in the directory.
Use this for files split by utilities like hjsplit and similar.
This command does not do/perform _any_ sanity checks before acting, except that it won't run unless there is a file that matches "*.001".
- The outfile should not already exist.
- There should be more than one file. (*.002 should exist as well as *.001)
- The file-count should match the number in the name of the last file in the series.
- None of the files should be empty.
- All files should be the same size, except for the last, which should usually be smaller, but never larger than the rest.
A safer altenative can be found here: http://pastebin.com/KSS0zU2F
alias mid='printf "\e[8;24;80;t"'
Resize participating terminals to classic 80x24 size.
Uses printf command to resize terminal.
So far, this is tested to NOT work in Konsole. Works with Mac Terminal, XFCE Terminal, XTerm, gnome-terminal.
xawtv -remote -bpp 16 -noxv-video -geometry 160x120 -device /dev/video0
View video cam from remote machine during ssh session
This command lets you view the cam on remote machine whilst connected via ssh. Note: must connect to remote machine with ssh -Y.
ipconfig getifaddr
Get Interface's IP on Mac
for i in `mysqladmin -h x.x.x.x --user=root -pXXXX processlist | grep <>| grep <>| awk {'print $2'}` do mysqladmin -h x.x.x.x --user=root -pXXX kill $i; done;
Kill multiple Locked connection by a single user in MYSQL DB
awk 'BEGIN{while (a++<50) s=s "-"; print s}'
Change the number 50 to whatever number of characters you want. Change the character inside the double quotes to whatever you want printed.
sshpass -p [password] rsync -av -e ssh [utente]@[indirizzoip]:/directorydacopiare/ /directorydidestinazione
Functions: rsync ssh
How to use rysnc over ssh tunnel
Check the ssh_config file and set the variable:
StrictHostKeyChecking no
echo "w" | fdisk /dev/sdb
Rescan partitions on a SCSI device
Used this after cloning a disk with dd to make the newly written partitions show up in /dev/
shopt -s globstar; rm -rfv **/.svn
ps aux | awk {'sum+=$3;print sum'} | tail -n 1
alias cls='printf %b '\''\033c'\'''
Clear scrollback on all participating terminals.
Syntax outside of an alias would be printf %b \\033c. This clears the screen and removes scrollback. Works on gnome-terminal and the XFCE's Terminal, and XTerm. It does clear the screen in Konsole and the Mac Terminal, but does not clear scrollback.
print 'g/'delete this line'/delete\nwq' | ex file.txt
Change a text files contents without opening it, or intermediate files.
If you've ever wanted to change a text files contents without having to create an intermediate file. This is it. Ex is a part of vim. The command as given will delete ALL lines containing "delete this line" from the file.
More Examples: print '%s/'this is a line'/'that is not the same line'/g\nwq' | ex file.txt will substitute the first string with the second string. print '3a\n'Inserted Line'\n.\n\nwq' | ex file.txt will insert the given line after line 3.
CAVEAT, Some distro's like the print command, others like echo with this command. Also note there are NO error messages on failure, at least that I've ever seen. Ex can also be quite fussy as to how it takes strings, parameters, etc... I use at&t's ksh syntax may very with other shells.
jot -s '' -b '-' 50
for ip in `seq 1 255`; do ping -c 1 192.168.1.$ip ; done | grep ttl
netstat -rn | grep UG | tr -s " " | cut -d" " -f2
Functions: cut grep netstat tr
‹ First < 228 229 230 231 232 > Last ›
alias differ='sdiff --suppress-common-lines $1 $2'
Often I need to diff two files and want the output side by side for ease of reading and I don't want to see common lines.
With this alias I just:
differ file1 file2
Ranking of the most frequently used commands
buf() { f=${1%%.*};e=${1/$f/};cp -v $1 $f-$(date +"%Y%m%d_%H%M%S")$e;}
$ buf a.txt
`a.txt' -> `a-20101215_104638.txt'
$ buf a.txt.gz
`a.txt.gz' -> `a-20101215_104647.txt.gz'
"infix" version in bash (4.x+)
Remove -v to make it silent.
BTW: The OP forgot to use "cat" and "nmap" ;-) I had a good laugh though.
find . -type f -name '*.pm' -printf '%6s %p\n' | sort -nr | head -n 50
Functions: find head sort
List 50 largest source files in a project
Will work with filenames with spaces inside. Will not break in case of someone making directory that matches *.pm. And sorts from largest. Where largest is file size, not line count.
pbpaste | ssh user@hostname pbcopy
Transfers clipboard content from one OS X machine to another
This uses ssh to transfer the contents of one Mac's clipboard to another's. This only works with plain text, sadly. Trying to transfer images will just clear out the remote machine's clipboard, and rich text will be converted to plain text. Using the "Remote Login" must be enabled on the remote machine (via System Preferences' Sharing panel) for this to work.
mplayer -endpos 0.1 -vo null -ao null -identify *.avi 2>&1 |grep ID_LENGTH |cut -d = -f 2|awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'
25:10:59
Functions: awk cut grep printf
Get the total length of all video / audio in the current dir in H:m:s
Better awk example, using only mplayer, grep, cut, and awk.
shred -vzu /tmp/junk-file-to-be-shredded
$ shred -vzu /tmp/junk-file-to-be-shredded
shred: /tmp/junk-file-to-be-shredded: pass 1/26 (random)...
shred: /tmp/junk-file-to-be-shredded: pass 2/26 (dddddd)...
shred: /tmp/junk-file-to-be-shredded: pass 3/26 (bbbbbb)...
shred: /tmp/junk-file-to-be-shredded: pass 4/26 (333333)...
shred: /tmp/junk-file-to-be-shredded: pass 5/26 (249249)...
shred: /tmp/junk-file-to-be-shredded: pass 6/26 (eeeeee)...
shred: /tmp/junk-file-to-be-shredded: pass 7/26 (cccccc)...
shred: /tmp/junk-file-to-be-shredded: pass 8/26 (888888)...
shred: /tmp/junk-file-to-be-shredded: pass 9/26 (ffffff)...
shred: /tmp/junk-file-to-be-shredded: pass 10/26 (666666)...
shred: /tmp/junk-file-to-be-shredded: pass 11/26 (555555)...
shred: /tmp/junk-file-to-be-shredded: pass 12/26 (777777)...
shred: /tmp/junk-file-to-be-shredded: pass 13/26 (random)...
shred: /tmp/junk-file-to-be-shredded: pass 14/26 (444444)...
shred: /tmp/junk-file-to-be-shredded: pass 15/26 (db6db6)...
shred: /tmp/junk-file-to-be-shredded: pass 16/26 (b6db6d)...
shred: /tmp/junk-file-to-be-shredded: pass 17/26 (000000)...
shred: /tmp/junk-file-to-be-shredded: pass 18/26 (999999)...
shred: /tmp/junk-file-to-be-shredded: pass 19/26 (492492)...
shred: /tmp/junk-file-to-be-shredded: pass 20/26 (aaaaaa)...
shred: /tmp/junk-file-to-be-shredded: pass 21/26 (924924)...
shred: /tmp/junk-file-to-be-shredded: pass 22/26 (6db6db)...
shred: /tmp/junk-file-to-be-shredded: pass 23/26 (222222)...
shred: /tmp/junk-file-to-be-shredded: pass 24/26 (111111)...
shred: /tmp/junk-file-to-be-shredded: pass 25/26 (random)...
shred: /tmp/junk-file-to-be-shredded: pass 26/26 (000000)...
shred: /tmp/junk-file-to-be-shredded: removing
shred: /tmp/junk-file-to-be-shredded: renamed to /tmp/000000000000000000000000
shred: /tmp/000000000000000000000000: renamed to /tmp/00000000000000000000000
shred: /tmp/00000000000000000000000: renamed to /tmp/0000000000000000000000
shred: /tmp/0000000000000000000000: renamed to /tmp/000000000000000000000
shred: /tmp/000000000000000000000: renamed to /tmp/00000000000000000000
shred: /tmp/00000000000000000000: renamed to /tmp/0000000000000000000
shred: /tmp/0000000000000000000: renamed to /tmp/000000000000000000
shred: /tmp/000000000000000000: renamed to /tmp/00000000000000000
shred: /tmp/00000000000000000: renamed to /tmp/0000000000000000
shred: /tmp/0000000000000000: renamed to /tmp/000000000000000
shred: /tmp/000000000000000: renamed to /tmp/00000000000000
shred: /tmp/00000000000000: renamed to /tmp/0000000000000
shred: /tmp/0000000000000: renamed to /tmp/000000000000
shred: /tmp/000000000000: renamed to /tmp/00000000000
shred: /tmp/00000000000: renamed to /tmp/0000000000
shred: /tmp/0000000000: renamed to /tmp/000000000
shred: /tmp/000000000: renamed to /tmp/00000000
shred: /tmp/00000000: renamed to /tmp/0000000
shred: /tmp/0000000: renamed to /tmp/000000
shred: /tmp/000000: renamed to /tmp/00000
shred: /tmp/00000: renamed to /tmp/0000
shred: /tmp/0000: renamed to /tmp/000
shred: /tmp/000: renamed to /tmp/00
shred: /tmp/00: renamed to /tmp/0
shred: /tmp/junk-file-to-be-shredded: removed
securely overwrite a file with random junk, rename it to clear the directory entry and finally delete it
sed -n 's/^model name[ \t]*: *//p' /proc/cpuinfo
Genuine Intel(R) CPU T2080 @ 1.73GHz
Alternative command to retrieve the CPU model name and strip off the "model name : " labels.
/^\([2-9]\d*\|1\d+\)
Finding all numbers that are bigger then 1 in vim
If we have a csv like structure:
And we wish to find all numbers that are bigger then 1 (or find a number that is bigger then 1 regardless of the structure), including numbers that start with 1 such as 10 and above.
mailq | grep MAILER-DAEMON | awk ?{print $1}? | tr -d ?*? | postsuper -d -
Functions: awk grep mailq tr
history | awk '{print $2,$3}' | sed s/sudo// | awk '{print $1}' | awk 'BEGIN {FS="|"}{print $1}' | sort | uniq -c | sort -n | tail | sort -nr
Functions: awk sed sort tail uniq
Your version works fine except for someone who's interested in commands 'sudo' was prefixed to
i.e. in your command, use of sudo appears as number of times sudo was used.
Slight variation in my command peeks into what commands sudo was used for and counts the command
(ignores 'sudo')
fig2dev -L eps file.fig file.eps
Converting your Xfig 'fig' files to 'eps' and others
There is a huge number of supported "languages" to which you can export your .fig figures to. See. 'man fig2dev' (http://linux.die.net/man/1/fig2dev).
gotxt2imgmail() { if [ $# != 1 ]; then echo 'gotxt2imgmail < email >'; return; fi; e="$1"; f=$RANDOM.png; convert label:@- $f; echo "" | mailx -s $f -a $f $e }
Functions: echo mailx
Pipe stdout to image and mail
sudo /sbin/ifconfig | gotxt2imgmail you@example.com
echo "root=/dev/sda7" > /proc/param.conf
Adding kernel boot parameters after loading kernel and initrd
Then exit from the shell.
exit
some time need to exit twice
exit exit
Now the OS will boot with the new parameters.
dpkg -l | grep (package name)
to know which package in Ubuntu is install
awk '{ for (f = 1; f <= NF; f++) a[NR, f] = $f } NF > nf { nf = NF } END { for (f = 1; f <= nf; f++) for (r = 1; r <= NR; r++) printf a[r, f] (r==NR ? RS : FS) }'
transpose a file
works the same as R's t()
cat `whereis mysqlbug | awk '{print $2}'` | grep 'CONFIGURE_LINE='
CONFIGURE_LINE="./configure '--build=i486-linux-gnu' '--host=i486-linux-gnu' '--prefix=/usr' '--exec-prefix=/usr' '--libexecdir=/usr/sbin' '--datadir=/usr/share' '--localstatedir=/var/lib/mysql' '--includedir=/usr/include' '--infodir=/usr/share/info' '--mandir=/usr/share/man' '--with-server-suffix=-d7-ourdelta44' '--with-comment=(OurDelta - http://ourdelta.org/)' '--with-system-type=debian-linux-gnu' '--enable-shared' '--enable-static' '--enable-thread-safe-client' '--enable-assembler' '--enable-local-infile' '--with-big-tables' '--with-unix-socket-path=/var/run/mysqld/mysqld.sock' '--with-mysqld-user=mysql' '--with-libwrap' '--without-openssl' '--with-yassl' '--without-docs' '--without-readline' '--with-extra-charsets=all' '--with-innodb' '--with-archive-storage-engine' '--with-csv-storage-engine' '--with-federated-storage-engine' '--with-blackhole-storage-engine' '--with-sphinx-storage-engine' '--without-embedded-server' '--with-ndbcluster' '--with-ndb-ccflags=-fPIC' '--with-ndb-sh
m' '--without-ndb-sci' '--without-ndb-test' '--with-embedded-server' '--with-embedded-privilege-control' '--without-ndb-docs' 'build_alias=i486-linux-gnu' 'host_alias=i486-linux-gnu' 'CC=gcc' 'CFLAGS=-DBIG_JOINS=1 -O2 -fPIC' 'CXX=g++' 'CXXFLAGS=-DBIG_JOINS=1 -felide-constructors -fno-rtti -O2'"
Functions: awk cat grep
hg diff -r$((`hg -q par | cut -d":" -f1`-1))
Functions: cut diff
diff from last committed revision in Mercurial
echo '' | php
cut -f1 -d" " ~/.bash_history | sort | uniq -c | sort -nr | head -n 30
Show the most commonly used commands from .bash_history
(sleep 3; echo "MyAwesomePassword"; sleep 3) |socat - EXEC:'ssh username@server "hostname"',pty,setsid,ctty
Use socat to wrap around your pty to enter the password.
You should really use keys. Really. I'm serious.
But if you have to add your key, change password etc. for a long list of servers, this might help.
chflags nohidden ~/Library
Show/Hide files in Mac OS X
Adds/Removes the hidden flag on a file or folder, making it invisible in the Finder.
ip link show eth0 | grep "link/ether" | awk '{print $2}'
...or for a particular interface...
echo - | sed -e :a -e 's/^.\{1,50\}$/&-/;ta'
the sed way to print a linhe with 50 hyphens
iconv -f UTF16LE -t UTF-8 < SOURCE | awk 'BEGIN { RS="\r\n";} { gsub("\n", "\r"); print;}' > TARGET
Functions: awk iconv
prepare unicode text saved from Microsoft Excel 2003 for unix console
Sometimes you want to work on data sheets by using heirloom unic commands like cut, paste, sed, sort, wc and good old awk. But your user works on Microsoft Excel spreadsheet. The idea:
1) ask your user to save it as "Unicode Text" from Microsoft Excel and send the document to you;
2) use the given command to convert it to UTF-8 text. We carefully convert "\r\n" to local end-of-line character; and to convert "\n" (in Excel, means linebreak within the table cell") to "\r", which is carrier return but not end-of-line in Unix. If the "\n" is not replaced with "\r", for example, wc -l will report incorrect column number.
‹ First < 229 230 231 232 233 > Last ›
socat READLINE EXEC:'sqlplus',pty,setsid,ctty
Get readline support for the sqlplus command.
Perhaps a bit of a niche, but if you've even been frustrated by Oracles sqlplus command line tool for not supporting readline - have no fear. Socat is here to help you.
wgetall () { wget -r -l2 -nd -Nc -A.$@ $@ }
Recursively download all files of a certain type down to two levels, ignoring directory structure and local duplicates.
wgetall mp3 http://example.com/download/
svn propget svn:externals -R [svn-repository-name]
$ svn propget svn:externals -R tools/
http://host/svn/tools/trunk/modules/timecalc
List all extneral depencies of an svn-repository
List all svn externals dependencies of a specific project.
user@hostname:~$
C:\home\user>
Make bash look like DOS
Credit goes here: http://blag.xkcd.com/2008/12/03/some-lists/
curl -i -X HEAD http://localhost/
ls / | sed -e :a -e 's/^.\{1,15\}$/&_/;ta'
bin_____________
boot____________
cdrom___________
dev_____________
etc_____________
home____________
use sed to simulate rpad and lpad
the sql command lpad and rpad using sed
for lpad, invert the &_ with _&:
ls / | sed -e :a -e 's/^.\{1,15\}$/_$/;ta'
atomtitles () { curl --silent $1 | xmlstarlet sel -N atom="http://www.w3.org/2005/Atom" -t -m /atom:feed/atom:entry -v atom:title -n}
> atomtitles http://rss.slashdot.org/Slashdot/slashdotatom
Atomic Weight Not So Constant
20 Years of Commander Keen
Amazon Taking Down Erotica, Removing From Kindles
Humble Bundle 2 Is Live
Air Force Blocks NY Times, WaPo, Other Media
FBI Alleged To Have Backdoored OpenBSD's IPSEC Stack
Fourth Amendment Protects Hosted E-mail
McDonald's Hacked and Customer Data Stolen
MS Hypes Win7 Tablets For CES — Again
Hidden Backdoor Discovered On HP MSA2000 Arrays
Julian Assange's Online Dating Profile Leaked
Why Special Effects No Longer Impress
Why Anonymous Can't Take Down Amazon.com
Watch 200 Years of Global Growth In 4 Minutes
Google Patents Browser Highlight All Button
Get the headlines of an atom feed
this simply curls the feed and runs a xpath query on it ...
ifconfig | awk '/HW/ {print $5}'
Simple MAC adrress, thanks to ifconfig.
C-x C-v, Enter
Reload an open file in emacs
If you have file opened in emacs and was just changed, the fastest way to reload the file is C-x C-v, as its default value is the path of the file.
ip2loc() { wget -qO - www.ip2location.com/$1 | grep "" | sed 's/<[^>]*>//g; s/^[\t]*//; s/"/"/g; s//>/g; s/&/\&/g'; }
$ ip2loc 167.4.1.41
UNITED STATES
Grabs the ip2location site and removes everything but the span tag containing the country value. Place it inside your .bashrc or .bash_aliases file.
buf() { cp -v $1 ${1/${1%%.*}/$f-$(date +"%Y%m%d_%H%M%S")};}
$ buf() { cp -v $1 ${1/${1%%.*}/$f-$(date +"%Y%m%d_%H%M%S")};}
`a.txt' -> `a-20101215_131256.txt'
`a.txt.gz' -> `a-20101215_131305.txt.gz'
even shorter (infix) version.
&& !
Run previous same command in history
lsof -n |grep delete
find the delete file ,which is in use
ls -1 $PATH*/* | xargs file | awk -F":" '!($2~/PDF document/){print $1}' |xargs rm -rf
Functions: awk file ls rm xargs
delete the files from the given directory except the PDF file
:1,$!sort
the '!' command in vi spawns a shell, then pipes all of the specified lines in the buffer through the command specified after '!', replacing all input lines with the result of the command.
tar -zxvf file.tar.gz
Unzip and untar a *.tar.gz file in one go
A *.tar.gz file needs to be unzipped & then untarred. Previously I might have unzipped first with
gunzip -d file.tar.gz
and then untarred the result with
tar -xvf file.tar
(Options are extract, verbose, file)
Using the -z (decompress) option on tar avoids the use of gzip (or gunzip) first.
dd if=FILE | pv -s $(stat FILE | egrep -o "Size: [[:digit:]]*" | egrep -o "[[:digit:]]*") | dd of=OUTPUT
Functions: dd egrep stat
Will automatically take the size of the file but longer, usefull only if in an function.
for x in *;do mv "$x" "`echo $x|tr [A-Z] [a-z]`";done
convert uppercase filenames in current directory to lowercase
as commented by Urk...
ack -o -h --nogroup --css 'url\((.*)\)' --output "\$1"
bingo.gif
background.png
http://example.com/images/flashy.jpg
List all background image URLs referenced in CSS files in directory and subdirectories
This searches through all CSS files in the current directory and sub-directories, matches the content between "url(...)", and prints a list of all the URLs. If you prefer to see the file the URL came from, remove the -h and --nogroup params.
find / -name "*.xls" -print0 | xargs -0 rename .xls .ods {}
Command to rename multiple file in one go
This command can be used to rename all the files with extension .xls( in this case) to .ods files. It can be used for other files with certain extension.
for k in `git branch|sed s/^..//`;do echo -e `git log -1 --pretty=format:"%Cgreen%ci %Cblue%cr%Creset" "$k" --`\\t"$k";done|sort
http://cl.ly/2t1U1s0K3G0n2A2W473u
psh:foursquare.web ryan$ for k in `git branch|sed s/^..//`;do echo -e `git log -1 --pretty=format:"%Cgreen%ci %Cblue%cr%Creset" "$k" --`\\t"$k";done|sort
2011-09-21 15:14:09 -0400 6 weeks ago i18n
2011-09-26 19:11:42 -0400 5 weeks ago soybeans-js
2011-10-26 01:53:40 -0400 7 days ago emails
2011-10-26 16:41:48 -0400 6 days ago ms-rd
2011-10-27 14:29:30 +0000 6 days ago master
2011-10-27 14:29:30 +0000 6 days ago nl
2011-11-01 09:40:05 -0400 17 hours ago snl
psh:foursquare.web ryan$
This fixes a bug found in the other scripts which fail when a branch has the same name as a file or directory in the current directory.
find -iname "*.pdf" -exec pdfinfo -meta {} \;|awk '{if($1=="Pages:"){s+=$2}}END{print s}'
78
This sums up the page count of multiple pdf files without the useless use of grep and sed which other commandlinefus use.
wget -H -r -nv --level=1 -k -p -erobots=off -np -N --exclude-domains=del.icio.us,doubleclick.net --exclude-directories=
my command for downloading delicious web links,
alias sucs="sort | uniq -c | sort -n"
$ last | awk '{print $1}' | sucs
23 fred
35 kathy
109 jim
$ awk '{print $1}' httpd-access.log | sucs
3 10.3.45.28
45 172.20.23.87
97 192.128.3.4
280 10.1.128.16
Print sorted count of lines
This alias finds identical lines in a file (or pipe) and prints a sorted count of them (the name "sucs" descends from the first letters of the commands). The first example shows the number of logins of users; the one who logged in most often comes last. The second example extracts web client IP addresses from a log file, then pipes the result through the "sucs" alias to find out which clients are performing the most accesses. Or pipe the first column of ps(1) output through "sucs" to see how many processes your users are running.
vnstat
Use it like this below:
vnstat -u -i interface forces a database update for interface or creates the database if it doesn't exist. This is
And one of out put will be below,
sudo /usr/bin/vnstat -l
Monitoring ppp0... (press CTRL-C to stop)
rx: 0.00 kB/s 0 p/s tx: 0.00 kB/s 0 p/s^C
ppp0 / traffic statistics
--------------------------------------+----------------------------------------
bytes 0 kB | 0 kB
packets 1 | 1
It has got so many wonderful switch to get the exact data you need.
Get the information about the internet usage from the commandline.
A wonderful command line utility to check the internet usage. It has got so many useful switch to display the data you want.Please visit the man page to get all the information.Get it from this website http://humdi.net/vnstat
‹ First < 230 231 232 233 234 > Last ›
python -c 'import datetime; print(datetime.date.today().isocalendar()[1])'
python one-liner to get the current week number
apt-show-versions | grep '\bpython\b'
rpm -q --whatprovides $filename
[mpb@localhost ~]$ rpm -q --whatprovides /bin/ed
ed-1.4-1mdv2010.0
find the rpm package name that provides a specific file
For Linux distributions using rpm (eg Mandriva), this command will find the rpm package name that provides a file.
ssh remotebox tail -f /var/log/remotelog
Functions: ssh tail
function t { ls -ltch $* | head -20 ; }
% t
total 79768
drwxr-xr-x 79 aks staff 2.6K Feb 24 23:38 aspell6-en-6.0-0/
drwxr-xr-x@ 53 aks staff 1.8K Feb 24 23:21 aspell-0.60.6/
-rw-r--r--@ 1 aks staff 1.7M Feb 24 23:14 aspell-0.60.6.tar.gz
A bash function to show the files most recently modified in the named (or current) directory
Coming back to a project directory after sometime elsewhere?
Need to know what the most recently modified files are?
This little function "t" is one of my most frequent commands.
I have a tcsh alias for it also:
alias t 'ls -ltch \!* | head -20'
ethtool eth0
sudo /usr/sbin/ethtool eth0
Settings for eth0:
Get ethernet card information.
This is an commandline utility to get fair piece of information about the attached network card.
wget -q -U busybox -O- "http://www.google.com/search?ie=UTF8&q=define%3A$1" | tr '<' '\n' | sed -n 's/^li>\(.*\)/\1\n/p'
$ def lek
A communal courtship arena which is used by several males to try to attract a female for mating.
This is a minimalistic version of the ubiquitious Google definition screen scraper. This version was designed not only to run fast, but to work using BusyBox. BusyBox is a collection of basic Unix tools that have been compiled into a single binary to save space on tiny installations of Unix. For example, although my phone doesn't have perl or the GNU utilities, it does have BusyBox's stripped down versions of wget, tr, and sed. It turns out that those tools suffice for many tasks.
Known Bugs: This script does not handle HTML entities at all. I don't think there's an easy way to do that within BusyBox, but I'd love to see it if someone could do it. Also, this script can only define a single word, not phrases. (Well, you could if you typed in %20, but that'd be gross.) Lastly, this script does not show the URL where definitions were found. Given the randomness of the Net, that last bit of information is often key.
lst=`find . -iname \*.c -or -iname \*.h`; for i in $lst; do emacs -nw -q $i --eval "(mark-whole-buffer)" --eval "(indent-region (point-min) (point-max) nil)" --eval "(save-buffer)" --kill; done
indenting all the files at a time, if the file has local variable for indentation style its even better.
This one liner is not pretty but it does the job.
seq 1 2 99999999 | sed 's!^!4/!' | paste -sd-+ | bc -l
$ seq 1 2 99999999 | sed 's!^!4/!' | paste -sd-+ | bc -l
3.14159263358979321063
Functions: bc paste sed seq
Calculate a transcendental number (pi)
Calculate pi from the infinite series 4/1 - 4/3 + 4/5 - 4/7 + ...
This expansion was formulated by Gottfried Leibniz: http://en.wikipedia.org/wiki/Leibniz_formula_for_pi
I helped rubenmoran create the sum of a sequence of numbers and he replied with a command for the sequence: 1 + 2 -3 + 4 ...
This set me thinking. Transcendental numbers!
seq provides the odd numbers 1, 3, 5
sed turns them into 4/1 4/3 4/5
paste inserts - and +
bc -l does the calculation
Note: 100 million iterations takes quite a while. 1 billion and I run out of memory.
continuar=true; while $continuar; do if ping -c 3 [target_IP_address] 2>&1> /dev/null ; then mplayer [sound_file]; continuar=false; break; fi; done
multimedia ping
If you're very busy and don't want to wait for a ping response, use it.
This command will be waiting for a successful ping response, to play a sound file to warn you that the target host is available.
apt-cache depends
$ apt-cache depends tar
tar
PreDepends: libc6
Suggests: bzip2
Suggests: ncompress
Suggests: xz-utils
Conflicts: cpio
Breaks: dpkg-dev
Replaces: cpio
Show package dependencies with apt
watch -n1 'netstat -tn | grep -P :22'
Monitoring a port connections
800768 blocks (25024Mb) written.
802285+0 records in
802284+0 records out
dd with nice progress bar
Use as normal dd, like:
Other alternatives:
dc3dd
(Quite verbose)
dd if=/dev/zero |pv|dd of=/dev/null
(More verbose)
cat file.php | perl -p -e 's/(\$|->)(str|arr|obj|int|flt|boo|bool|mix|res)([A-Z])/$1\L$3/g'
Strip out Hungarian notation from a PHP file
This removes the type prefix used in Hungarian notation (v. bad) for PHP variables. Eg. variables of the form $intDays, $fltPrice, $arrItems, $objLogger convert to $days, $price, $Items, $logger.
echo "\"\e[5~\": history-search-backward" >> ~/.inputrc
Use the page up key to complete the command.
What this does is, if I type ?ssh ? then hit the page-up key, it will complete the line to the last time in my history file that I typed ssh. Hitting page up again will go to the 2nd to last time I typed it. Incredibly handy if you ever type the same commands more than once.
credit goes to http://www.sharms.org/blog/2009/03/10/make-your-bash-shell-cool-again/
echo "\"\e[6~\": history-search-forward" >> ~/.inputrc
function headers { head -1 $* | tr ',' '\12' | pr -t -n ; }
% headers table.csv
1 Date
2 Open
3 High
4 Low
5 Close
6 Volume
7 Adj Close
Functions: head pr tr
Show the ordered header line (with field names) of a CSV file
This little command (function) shows the CSV header fields (which are field names separated by commas) as an ordered list, clearly showing the fields and their order.
git clean -n | sed 's/Would remove //; /Would not remove/d;' | xargs mv -t stuff/
Functions: mv sed xargs
Move all files untracked by git into a directory
open-command $(ls -rt *.type | tail -n 1)
Open the last modified file of a certain type
Change open-command and type to suit your needs. One example would be to open the last .jpg file with Eye Of Gnome:
eog $(ls -rt *.jpg | tail -n 1)
variable="foo" && sed 's/bar/'$variable'/g' $variable.conf >> $variable.temp && sed '1,5d' $variable.temp && mv $variable.temp $variable.conf
server {
listen 80;
server_name www.foo.com;
access_log /var/log/nginx/access.log main;
error_log /var/log/nginx/error.log warn;
Find, Replace, Write & Remove First 5 Lines
I wrote this script to speed up Nginx configs. This (long) one liner can be run via BASH. You will see that we set a variable in bash called 'foo' and the streamline editor (sed) finds 'bar' in 'foo.conf' next it writes that output to a temp file (foo.temp) and removes the first 5 lines (that aren't needed in this case) & lastly it moves (overwrites) foo.temp to foo.conf
apt-cache rdepends
$ apt-cache rdepends tar
Reverse Depends:
file-roller
vfu
newlib-source
|dvbackup
dump
amanda-common
backuppc
Show package reverse dependencies with apt
perl -F'\s+' -anE 'push @w,$F[1];END{$r.=splice @w,rand @w,1 for(1..4);say $r}' diceware.wordlist.asc
snapcodonmarshstink
Before running, do:
curl -sO http://world.std.com/%7Ereinhold/diceware.wordlist.asc
$(($(hostname|sum|cut -f1 -d" ")%27+1))
Command to generate an integer from the hostname, valid within the Days of Month
Requirements:
Output: integer x , 1>=x
Input: hostname
Able to reproduce on the same host
Acceptable for output to be different among OSes (Solaris, Linux, BSD)
Useful for providing DayOfMonth splay in cron jobs. Capped at 28 for Febtober.
ssh-keygen -i -f $sshkeysfile >> authorized_keys
Convert an ssh2 public key to openssh format
for i in `find . -type f`; do sed -i '/group name/s/>/ deleteMissing="true">/' $i; done
Before:
After:
Recursively replace a string in files with lines matching string. Lines with the string "group name" will have the first > character replaced while other > characters on other lines will be ignored.
tar --exclude=".??*" -zcvf ./home_backup_2008.tar.gz my_home
backup home dir exclude dot files
‹ First < 231 232 233 234 235 > Last ›
seq -w 50 | sort -R | head -6 |fmt|tr " " "-"
Functions: head seq sort tr
sw_vers [-productName|-productVersion|-buildVersion]
Get version values (ProductName, ProductVersion, BuildVersion) for Mac OS X
echo 'example.com%2Fsome%2Fpath' | ruby -r'cgi' -e 'puts CGI.unescape(STDIN.read)'
un-escape URL/URIs with Ruby
for i in `seq 100`; do mkdir f${i}; touch ./f${i}/myfile$i ;done
creates 100 directories f(1-100) with a file in each matched to the directory (/f1/myfile1, .. /f98/myfile98,/f99/myfile99/,/f100/myfile100,etc )
Functions: mkdir touch
mkdir some file and mv some file
creates 100 directories f(1-100) with a file in each matched to the directory (/f1/myfile1, .. /f98/myfile98,/f99/myfile99/,/f100/myfile100,etc )
python -c 'print hex(1337)'
0x539
Python is always such much more readable than most shell scripting.
fsutil file createnew FILENAME filesize(inbytes)
fsutil file createnew deleteme 1024
File C:\deleteme is created
C:\>dir deleteme
Directory of C:\
02/05/2009 12:33 PM 1,024 deleteme
Create files of arbitrary size in Windows
This command creates a file of arbitrary size in a windows environment.
mencoder -of avi -ovc lavc movie.avi -o movie2.avi; ffmpeg -i movie2.avi -r 12 -b 100 movie.flv
Convert a VMWare screencast into a flv file
First, we convert the VMware avi (VMnc format) to the Microsoft avi format. Next, we convert the Microsoft avi format to FLV format.
You can play around with the -r switch (rate per second) and the -b switch (bitrate). But, if those get larger, so does your FLV file.
git remote prune origin
Pruning origin
URL: git@github.com:app/signup.git
* [pruned] origin/1099_feature1
* [pruned] origin/2562_feature2
* [pruned] origin/2576_feature3
* [pruned] origin/2576_feature4
* [pruned] origin/2591_feature5
Remove branches that no longer exist from being shown via 'git branch -a'
If you rebase and delete a lot of remote branches via git, your list of branches will end up showing branches on origin that no longer exist. This command will clear them out.
LESSOPEN="| /usr/bin/lesspipe %s" less file.jar
This of course assumes that lesspipe is installed. You can view the contents of many, many types of files in this way. Once lesspipe is installed, add to your .bashrc
export LESSOPEN="| /usr/bin/lesspipe %s" less file.jar
export LESSCLOSE="/usr/bin/lesspipe %s %s"
eval "$(lesspipe)"
find . -type f -size +20000k -print0 | xargs -0 du -h | awk -F"\t" '{printf "%s : %s\n", $2, $1}'
Find Files over 20Meg
Output made so that it will match initial suggestion for this task. Personally, I think that output of du -h is more readable.
ps -u `/usr/xpg4/bin/id -u`
Find processes by current user on a Solaris box
6 characters counting whitespace!
python -c 'print "hello".encode("hex")'
68656c6c6f
You can use "decode()" in a similar manner:
python -c 'print "68656c6c6f".decode("hex")'
find . -name Root -print | xargs rm -f
Remove CVS root files under current directory
/sbin/ifconfig | awk -F'[ :]+' '/inet addr/{print $4}'
That one works on Linux. On BSD and Solaris, the ifconfig output is much easier to parse:
/sbin/ifconfig -a | awk '/inet/{print $2}'
find -type f |while read a;do [ "`head -c3 -- "${a}"`" == $'\xef\xbb\xbf' ] && echo "Match: ${a}";done
Match: ./wps.ear/wps.war/themes/html/QPG/pageHeader.html
Same thing, only "head" instead of grep/egrep..
echo Your_Chinese_Char | uniconv -encode Chinese-WB
gnu@robby:~$ echo ?? | uniconv -encode Chinese-WB
if tvfh
gnu@robby:~$
convert chinese character into wubi86 input code
This CLI requiere the uniconv package that is provided with the yudit unicode editor .
The wubi86 is a way to type chinese far quicker than pinyin .
More infor on wikipedia : http://en.wikipedia.org/wiki/Wubizixing , http://www.yale.edu/chinesemac/wubi/xing.html
mplayer -vo null -ao null -frames 0 -identify movie.avi | awk '{FS="="}; /ID_LENGTH/{ H=int($2/3600); M=int(($2-H*3600)/60); S=int($2%60); printf "%d:%02d:%02d\n",H,M,S}'
2:00:05
Prints movie length in H:MM:SS format with appropriate leading zeros.
du -kh --max-depth=1 | sort -n |head
get biggest directories
isdef() { eval test -n \"\${$1+1}\"; }
$ isdef a_var; echo $?
$ a_var=1
Functions: eval test
Got the idea from there http://fixunix.com/questions/15902-bash-checking-if-env-var-set.html
mpg123 -s input.mp3 | faac -P -X -w -o output.m4b -
conver mp3 to m4b
echo "scale=6;2048 / 2.345" | bc
gnu@robby:~$ echo "scale=6;2048 / 2.345" | bc
873.347547
get value after comma from an arithmetic operation
scale define the number you want after comma
find . -iname \*.c -or -iname \*.h -exec emacs -nw -q {} --eval "(progn (mark-whole-buffer) (indent-region (point-min) (point-max) nil) (save-buffer))" --kill \;
Use find's exec and reduce the need for multiple evals with a progn wrapper.
ifconfig | grep HWaddr
-bash-3.00$ /sbin/ifconfig | grep HWaddr
eth0 Link encap:Ethernet HWaddr 00:50:56:9C:69:6F
eth1 Link encap:Ethernet HWaddr 00:50:56:9C:16:C6
-bash-3.00$
plain and simple
glu() { (local IFS="$1"; shift && echo "$*") }; repath() { ( _E=`echo "${PATH//:/$'\n'}" | awk '!x[$0]++'`; glu ":" $_E ) ; } ; PATH=`repath` ; export PATH
Functions: awk echo export shift
Speed up builds and scripts, remove duplicate entries in $PATH. Users scripts are oftern bad: PATH=/apath:$PATH type of thing cause diplicate.
Thanks to the authors of:
and the author of:
joinargs() { (local IFS="$1"; shift && echo "$*") }
and others, we can have a fast Linux or android.
IMPORTANT if you find a priority order problem in PATH you can push a path directory to the front without duplication as follows:
PATH=/bin:$PATH
then ...
Check duplication with:
Finally do a very neat line by line list of $PATH:
echo "${PATH//:/$'\n'}
The speed up is very noticeable for android, and builds on Linux Ubantu are much faster with make and scripts.
I will update the command on request. Timothy from SONY
‹ First < 232 233 234 235 236 > Last ›
pdftk input1.pdf input2.pdf cat output output.pdf
echo "shopt -s histappend" >> ~/.bashrc ; . ~/.bashrc
Prevent command history file from being overwritten by multiple shell sessions.
Takes effect immediately.
cvs up -pA main.cpp | sdiff -s - main.cpp
Functions: cvs sdiff
cvs diff HEAD and current branch
you can't reliably use diff against -r HEAD to test whether a file matches the head of the trunk.
git clean -dfx
Remove all untracked files/directories from the working tree of a git repository.
man () { if [[ $(type ${1}) =~ "is a shell builtin" ]]; then; /usr/bin/man -P "/usr/bin/less -iRs --pattern=\"^ *${1}\"" bash; else; /usr/bin/man ${1}; return; fi; }
$ man ulimi
Functions: man type
Go to man section of bash builtins
ulimit [-SHacdflmnpstuv [limit]]
Provides control over the resources available to the shell and to processes started by it, on systems that allow such control. The -H
and -S options specify that the hard or soft limit is set for the given resource. A hard limit cannot be increased once it is set; a
soft limit may be increased up to the value of the hard limit. If neither -H nor -S is specified, both the soft and hard limits are set.
# jumps straight to the definition of ulimit in the bash man page.
grep -RE 'class\s+(\w+)' --color *
grep all class definitions from all files in current directory
function xzv() { THREADS=`grep processor /proc/cpuinfo | wc -l`; for file in $*; do pv -s `stat -c%s $file` < $file | pxz -q -T $THREADS > $file.xz ; done; }
Functions: file wc
Parallel XZ with progress bar
You need: pxz for the actual work (http://jnovy.fedorapeople.org/pxz/). The function could be better with better multifile and stdin/out support.
tar cvfz dir_name.tgz dir/
Command
----------------
root@hostname /var/www$ tar cvfz html.tgz html/
html/
html/.htaccess
html/wiki/
html/wiki/serialized/
Output
---------------------
root@hostname /var/www$ ll
total 16464
Tar a directory and its sub-directory
This command creates tar zip of a directory and its sub-directories.
2end () ( export LC_ALL=C; nl -n rz $1 > $1.tmp; ${EDITOR:-vi} $1.tmp; sort $1.tmp | sed -r 's/^.*[0-9]+\t+//' > $1; rm $1.tmp; )
$ 2end /tmp/2end.txt
~000001 rough
000002 slimy
!000003 red
~000004 fluff
000005 dough
$ cat /tmp/2end.txt
red
slimy
dough
rough
fluff
Functions: export nl rm sed sort
sort selected lines in a text file to the beginning or end of the file.
This function is used to sort selected lines of a text file to the end of that file. Especially useful in cases where human intervention is necessary to sort out parts of a file. Let's say that you have a text file which contains the words
rough
slimy
red
fluff
dough
For whatever reason, you want to sort all words rhyming with 'tough' to the bottom of the file, and all words denoting colors to the top, while keeping the order of the rest of the file intact.
'$EDITOR' will open, showing all of the lines in the given file, numbered with '0' padding. Adding a '~' to the beginning of the line will cause the line to sort to the end of the file, adding '!' will cause it to sort to the beginning.
set env DYLD_INSERT_LIBRARIES = /usr/lib/libgmalloc.dylib;b szone_error
Functions: env set
Setting gdb in memory allocation debugging mode under MAC OS X
setting gdb with this option / breakpoint before running the process will cause it to break whenever an memory allocation operation is not kosher.
find . -type f -printf %s\\n | paste -sd+ | bc
9346375
Functions: find paste
Computes total size of files in a directory. This value is different "du -b" because doesn't includes directory sizes.
/usr/bin/play -q -n synth brown band -n 1200 200 tremolo 0.05 80
Generate soothing noise
Substitute 'brown' with 'pink' or 'white' according to your taste.
I put this on my headphones when I'm working in an "open concept" office, where there are always three to five conversations going in earshot, or if I'm working somewhere it is "rude" of me to tell a person to turn off their cubicle radio.
curl -s http://example.com | grep -o -P "" | grep -o "http.*.pdf" | xargs -d"\n" -n1 wget -c
Functions: grep wget xargs
This example command fetches 'example.com' webpage and then fetches+saves all PDF files listed (linked to) on that webpage.
[*Note: of course there are no PDFs on example.com. This is just an example]
svn diff --diff-cmd diff -x -uw /path/to/file
svn diff ignore whitespace
get subversion diff output without distracting whitespace changes. good for when you are cleaning up code to make sure you didn't change anything important. also useful when working with old code, or someone else's code.
rpm2cpio /path/to/file.rpm | cpio -i -d
Extract the contents of an RPM package to your current directory without installing them.
This assumes you have the 'rpm', 'rpm2cpio' and 'cpio' packages installed. This will extract the contents of the RPM package to your current directory. This is useful for working with the files that the package provides without installing the package on your system. Might be useful to create a temporary directory to hold the packages before running the extraction:
mkdir /tmp/new-package/; cd /tmp/new-package
perl -i -pe 's/\xef\xbb\xbf//g'
Fix UTF-8 text files misinterpreted as ISO 8859-1 due to Byte Order Mark (BOM) of the Unicode Standard.
Fixes the faulty files with perl, which may exist on more platforms
python -c 'print "-" * 50'
python -c "from distutils.sysconfig import get_python_lib; print get_python_lib()"
Python: Quickly locate site-packages
lynx -dump http://www.anti-abuse.org/multi-rbl-check/ | grep ']' | awk -F\] '{ print $2 }' | sed '/^\[/d' | egrep -v ^[A-Z]
Functions: awk egrep grep sed
Scrape all RBLs off the anti-abuse.org site
iwconfig wlan0 mode monitor
wlan0 IEEE 802.11abgn Mode:Monitor Tx-Power=20 dBm
place wifi card into monitor mode
This command will place your card into monitor mode. Gets around the "ioctl(SIOCSIWMODE) failed: Device or resource busy" error encountered when running airodump-ng.
INPUT= && ffmpeg -i "$INPUT" -vn -f wav - | oggenc -o ${INPUT%%.*}.ogg -
Convert a videos audio track to ogg vorbis.
Assumes you have ffmpeg and oggenc.
Similar to other scripts here, but this time outputting to Ogg Vorbis.
I added the variable assignment for a nice output name.
This is part of an interactive bash script I have with a few little multimedia tasks in it.
http://www.dward.us/software/VSAK.sh
echo $X | egrep "^[0-9]+$"
Functions: echo egrep
svn st | grep -e '^M' | awk '{print $2}' | xargs svn revert
Revert all modified files in an SVN repo
rtfm() { help $@ || $@ -h || $@ --help || man $@ || $BROWSER "http://www.google.com/search?q=$@"; }
Sometimes you don't have man pages only '-h' or '--help'.
NotifyOnBATTERY () { while :; do on_ac_power||notify-send "Running on BATTERY"; sleep 1m; done }
[On top right corner]
Running on BATTERY
Notify on Battery power
Works on Laptops, Desktop having communication b/w UPS & CPU
‹ First < 233 234 235 236 237 > Last ›
w_scan -X -P -t 2 -E 0 -c IT > dvb-channels.conf
w_scan version 20100316 (compiled for DVB API 5.1)
using settings for ITALY
DVB aerial
DVB-T Europe
frontend_type DVB-T, channellist 4
output format czap/tzap/szap/xine
Info: using DVB adapter auto detection.
Using DVB-T frontend (adapter /dev/dvb/adapter0/frontend0)
-_-_-_-_ Getting frontend capabilities-_-_-_-_
Using DVB API 5.1
frontend DiBcom 7000PC supports
INVERSION_AUTO
QAM_AUTO
TRANSMISSION_MODE_AUTO
GUARD_INTERVAL_AUTO
HIERARCHY_AUTO
FEC_AUTO
-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_-_
Scanning 7MHz frequencies...
build DTT channel list with w-scan
Use w_scan to build italian DTT video channel list. To change country, substitute IT with 2 letter country code. Userful to be played in vlc by:
vlc -f dvb-channels.conf
nm-tool 2>/dev/null|sed -n '/Type:[ ]*802.11 WiFi/,/IPv4 Settings/{ /State:[ ]*connected/,/IPv4 Settings/{ s/^[ ]*//;/^\*.*Infra/ { s/^*//;s/:.*//;p }}}'
Functions: nm sed
Get current connected wireless network with nm-tools
Gets only when the state is connected.
git status | perl -F'\s' -nale 'BEGIN { $a = 0 }; $a = 1 if $_ =~ /changed but not updated/i; print $F[-1] if ( $a && -f $F[-1] )'
Show the changed files in your GIT repo
Parse the output of git status.
Once the line '# Changed but not updated:' has passed print every last part of the line if it exists on disk.
unhide (proc|sys|brute)
[*]Searching for Hidden processes through /proc scanning
Forensic tool to find hidden processes and ports
Unhide is a forensic tool to find processes and TCP/UDP ports hidden by rootkits, Linux kernel modules or by other techniques. It includes two utilities: unhide and unhide-tcp.
users | xargs -n1 echo | sort | uniq -c
Functions: echo sort uniq users xargs
List and count the number of open sessions per user
while true; do tput sc; tput cup 0 $(($(tput cols)-74)); w | grep load; tput rc; sleep 10; done &
11:27:27 up 23:41, 1 user, load average: 0.29, 2.34, 3.72
Functions: grep sleep tput
Gives not only date but also some interesting status about the System
tar -caf some_dir.tar.xz some_dir
have tar decide compression based on filename
the -a flag causes tar to automatically pick the right compressor to filter the archive through, based on the file extension. e.g.
"tar -xaf archive.tar.xz" is equivalent to "tar -xJf archive.tar.xz"
"tar -xaf archive.tar.gz" is equivalent to "tar -xzf archive.tar.gz"
No need to remember -z is gzip, -j is bzip2, -Z is .Z, -J is xz, and so on :)
rename.ul "" 00 ?.jpg; rename "" 0 ??.jpg;
Not as elegant as the zmv version.
ac -p | sort -nk 2 | awk '/total/{print x};{x=$1}'
Show which user has the most accumulated login time
echo $(( (1234567890 - `date -u +\%s`) / 60 / 60 ))
hours before the time()==1234567890
head -c10 <(echo $RANDOM$RANDOM$RANDOM)
Makes use of $RANDOM environment variable.
xrandr -q | awk -F'current' -F',' 'NR==1 {gsub("( |current)","");print $2}'
alias sete='set|sed -n "/^`declare -F|sed -n "s/^declare -f \(.*\)/\1 ()/p;q"`/q;p"'
BASH=/bin/bash
BASH_ARGC=()
BASH_ARGV=()
BASH_LINENO=()
BASH_SOURCE=()
BASH_VERSINFO=([0]="3" [1]="2" [2]="25" [3]="1" [4]="release" [5]="i686-redhat-linux-gnu")
BASH_VERSION='3.2.25(1)-release'
BKDIR=/home/askapache/.bk
BROWSER=/usr/bin/lynx
COLORS=/home/askapache/.dircolors
COLUMNS=271
CR=$'\E[m\017\E)0'
CVS_RSH=ssh
DIRSTACK=()
EDITOR=/usr/bin/vim
EUID=32011
GREP_OPTIONS='-D skip --binary-files=without-match'
GROUPNAME=askapache
GROUPS=()
Normally the bash builtin command 'set' displays all vars and functions. This just shows the vars. Useful if you want to see different output then env or declare or export.
Alias 'sete' shows sets variables
Alias setf shows the functions.
alias setf='set|sed -n "/^`declare -F|sed -n "s/^declare -f \(.*\)/\1 ()/p;q"`/,\$p"'
Also see: http://www.commandlinefu.com/commands/view/6899/print-all-environment-variables-including-hidden-ones
At the very least, some cool sed commands!
From my .bash_profile http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html
aptitude search -F "%p" --disable-columns ~i
Print sorted list of all installed packages (Debian)
You can then do all the processing you wish... It's already sorted and only installed packages are listed.
EDIT: Now contains formatting option to list only package names! Also, disables truncating long package names.
NOTE: it's tilda i not dash i
find . -iname '*.php' | xargs grep "searh string" -sl
-sl : show just file names
date -d @$(echo $(($(date +%s)-$(cat /proc/uptime|cut -d. -f1))))
Functions: cat cut date echo
Knowing when a machine is turned on
find . -iname "*.cpp" -exec perl -ni -e 'chomp; print "$_\n"' {} \;
Add a newline to the end of a cpp file
Adds a newline to the end of all cpp files in the directory to avoid warnings from gcc compiler.
while [ 1 ]; do du /var/log/messages;sleep 60; done
2380 messages
2396 messages
2401 messages
Got a file you're generating and you want the size without typing in 'ls -l file' all the time? Use this instead.
/sbin/route -n | grep "^0\.0\.0\.0" | awk '{ print $2 }'
same thing without loop ;)
echo StrinG | tr 'A-Z' 'a-z'
Another way to do it with slightly fewer characters. It doesn't work on Russian characters; please don't vote down because of that. :p It's very handy for those of us working in ascii :)
mv -i something.conf{,~} && sed "/regexp/s/^/#/" < something.conf~ > something.conf
Comment out all lines in a configuration file matching a regexp, creating a backup.
i=3; echo 10.0.0.1 | sed "s/\([0-9]\{1,3\}\.\)\([0-9]\{1,3\}\.\)\([0-9]\{1,3\}\.\)\([0-9]\{1,3\}\)/\1\2\3$i/g"
replace one of the octates of an IP
the numbers in the ip address are represented in sed as \1\2\3\4. If I put \1\2\3$i, then I change the last number. So for example to change the second number I'll do \1$i\3\4.
Regards,
Kfir
echo "abcde" | sed 's/./& /g'
$ echo "abcde" | sed 's/./& /g'
a b c d e
Matched string reference in replacement text
Use matched data and some other as replacement data
git tag -l --contains 18f6f2 live*
live-20100121
live-20100215
which git tags include this commit?
This will list all tags that match the live* glob and contain commit 18f6f2
find ~/.thunderbird/*.default/ -name *.msf -delete
‹ First < 234 235 236 237 238 > Last ›
for f in *.doc ; do wvHtml $f ${f%.doc}.html ; done
Convert all Microsoft Word files in current directory to HTML.
This requires wvWare, which under Debian is in the wv package. Alternative converters can be used, e.g., jodconverter, which uses OO.O instead (no X server need be running.)
mydir=$(cd $(dirname ${BASH_SOURCE:-$0});pwd)
I submitted a command like this without $0 if $BASH_SOURCE is unset. Therefor, it did only work when using ./script, not using 'sh script'. This version handles both, and will set $mydir in a script to the current working directory. It also works on linux, osx and probably bsd.
cd / ; tar -cvpzf backup.tar.gz --exclude=/backup.tar.gz --exclude=/proc --exclude=/lost+found --exclude=/sys --exclude=/mnt --exclude=/media --exclude=/dev /
Backup entire system
Backup your entire system on a tar ball file format.
switchMonitor () { LF=/tmp/screen-lock; if [ -f $LF ]; then rm $LF; else touch $LF; sleep .5; while [ -f $LF ]; do xset dpms force off; sleep 2; done; fi };
Functions: rm sleep touch
shut of the screen ( Fool proof )
Use the command to create a script and bind it to a key using keyboard shortcut.
Script locks the screen in a loop until the command is executed again.At first it
find . -iname "*.mp3" -execdir mid3iconv -e {} \;
Fix MP3 tags encoding (to UTF-8). Batch fixes all MP3s in one directory.
Fixes MP3 tags encoding (to UTF-8).
Batch fixes all MP3s in one directory.
lol=`zenity --entry` && DISPLAY=:0.1 cvlc -f -I ncurses --play-and-exit "$lol"
run zenity object on local machine for to insert video stream url to play on remote machine
use this command via ssh on remote machine when you want play video stream or path to file
alias testh='help test|sed -e :a -e "$!N;s/\(-n STRING\)\n/\1, /;s/\n\( \{23\}\| \{4\}\([a-z]\)\)/ \2/;ta;P;D"|sed "s/ \{1,\}/ /g;/^ $/d;/:$/s/^/\n/"|sed -n "/File operators:/,\$p"'
File operators:
-a FILE True if file exists.
-b FILE True if file is block special.
-c FILE True if file is character special.
-d FILE True if file is a directory.
-e FILE True if file exists.
-f FILE True if file exists and is a regular file.
-g FILE True if file is set-group-id.
-h FILE True if file is a symbolic link.
-L FILE True if file is a symbolic link.
-k FILE True if file has its `sticky' bit set.
-p FILE True if file is a named pipe.
-r FILE True if file is readable by you.
-s FILE True if file exists and is not empty.
-S FILE True if file is a socket.
-t FD True if FD is opened on a terminal.
-u FILE True if the file is set-user-id.
-w FILE True if the file is writable by you.
-x FILE True if the file is executable by you.
-O FILE True if the file is effectively owned by you.
-G FILE True if the file is effectively owned by your group.
-N FILE True if the file has been modified since it was last read.
FILE1 -nt FILE2 True if file1 is newer than file2 (according to modification date).
FILE1 -ot FILE2 True if file1 is older than file2.
FILE1 -ef FILE2 True if file1 is a hard link to file2.
String operators:
-z STRING True if string is empty.
-n STRING, STRING True if string is not empty.
STRING1 = STRING2 True if the strings are equal.
STRING1 != STRING2 True if the strings are not equal.
STRING1 < STRING2 True if STRING1 sorts before STRING2 lexicographically.
STRING1 > STRING2 True if STRING1 sorts after STRING2 lexicographically.
Other operators:
-o OPTION True if the shell option OPTION is enabled.
! EXPR True if expr is false.
EXPR1 -a EXPR2 True if both expr1 AND expr2 are true.
EXPR1 -o EXPR2 True if either expr1 OR expr2 is true.
arg1 OP arg2 Arithmetic tests. OP is one of -eq, -ne, -lt, -le, -gt, or -ge.
Arithmetic binary operators return true if ARG1 is equal, not-equal, less-than, less-than-or-equal, greater-than, or greater-than-or-equal than ARG2.
Test quick help alias
Just a nice alias so if you need help with test you can just do
testh
ssh -i /root/.ssh/username\@hostname -p 222 username@hostname
SSH connection with private key and port 222
ls -1 | awk ' { print "zip "$1".zip " $1 } ' | sh
Zip each file in a directory individually with the original file name
This will list the files in a directory, then zip each one with the original filename individually.
video1.wmv -> video1.zip
video2.wmv -> video2.zip
This was for zipping up large amounts of video files for upload on a Windows machine.
ps auxf
svcsuprt 4032 0.1 0.5 8972 1900 ? S Feb01 7:14 | \_ sshd: svcsuprt@pts/0
svcsuprt 4033 0.0 0.4 6504 1472 pts/0 Ss Feb01 0:00 | \_ -bash
ps with parent/child process tree
Shows a tree view of parent to child processes in the output of ps (linux). Similar output can be achieved with pstree (also linux) or ptree (Solaris).
hostinfo.sh
==============================
HOSTNAME testlab
HOSTTYPE i386-linux
MACHINETYPE i386
OSTYPE linux
VENDOR intel
KERNEL 2.6.9
GLIBC 2.3
_HOSTNAME=`hostname`
_HOSTTYPE=`echo $HOSTTYPE`
_MACHINETYPE=`echo $MACHTYPE`
_OSTYPE=`echo $OSTYPE`
_VENDOR=`echo $VENDOR`
_KERNEL=`uname -r | awk -F- '{print $1}'`
_GLIBC=`ls /lib/libc-*.so | awk -F- '/lib/ {print $2}' | awk -F. '{print $1"."$2}'`
_MEM=`cat /proc/meminfo | awk '/MemTotal/ {print $2 $3}'`
_CPU=`cat /proc/cpuinfo | grep 'cpu MHz' | awk '{print $4}'`
echo '=============================='
echo 'HOSTNAME ' $_HOSTNAME
echo 'HOSTTYPE ' $_HOSTTYPE
echo 'MACHINETYPE ' $_MACHINETYPE
echo 'OSTYPE ' $_OSTYPE
echo 'VENDOR ' $_VENDOR
echo 'KERNEL ' $_KERNEL
echo 'GLIBC ' $_GLIBC
echo 'MEM INFO ' $_MEM
echo 'CPU INFO ' $_CPU
instfix -icq | grep 5300-07_AIX_ML | grep ":-:"
AIX: Determine what filesets are missing to reach a TL
This will let you know what filesets or fixes (if any) are missing in order to be considered "at" a given technology level in AIX.
scrot -e 'mv $f \$HOME/public_html/shots/; echo "http://\$HOSTNAME/~\$USER/shots/$f" | xsel -i; feh `xsel -o`'
Easily create and share X screen shots (local webserver version)
A web server using $HOME/public_html as user directory is required, $HOME/public_html/shots must exist and have appropriate access rights and $HOSTNAME must be known to and accessible from the outside world.
The command uses scrot to create a screen shot, moves it to the screen shot directory, uses xsel to copy the URL to the paste buffer (so that you can paste it with a middle click) and finally uses feh to display a preview of the screen shot.
Assign this command to a key combination or an icon in whatever panel you use.
firefox --safe-mode
how to run firefox in safe mode from command line
Sometime you need to run firefox from the command just to rectify something about it.Means,if some of the addon broke you firefox setting or theme broke your ff setting then fall back to commandline i.e shell and type the mentioned command. It will open up an information box with few option along with the checkbox besides them(means you can select them) to start the web browser in safe mode.Besically deactivating all the addon and theme,except the default one.Once you are done/rectified thing ..close that session and reopen the browser normally.It should work.
cat *.sql | mysql
Execute all SQL files in a directory
lol=`zenity --file-selection --directory` && DISPLAY=:0.1 cvlc -f -I ncurses --play-and-stop "$lol"
run zenity object on local machine for select all directory file to play on remote machine
use this command via ssh on remote machine when you want play video
remove --directory if you want select single file
gcal -i -s1 -qcn --chinese-months -cezk .
Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa Su
1 2 3 4 5 6 7 1 2 3 4 5 : 1: 2:
8 9 10 11 12 13 14 6 7 8 9 10 11 12 3 4 5 6 7 8 9
Fixed date list:
1) |44| Sa, 6 Nov 2010: Start of common month 10/4647 (Chi*)
2) |49| Mo, 6 Dec 2010: Start of common month 11/4647 (Chi*)
3) |51| We, 22 Dec 2010: Solstice Day (CN)
4) |52/0| Sa, : 1:Jan 2011: New Year's Day (CN)
5) |52/0| Su, : 2:Jan 2011: New Year's Day (CN)
6) |01| Tu, 4 Jan 2011: Start of common month 12/4647 (Chi*)
附带节假日和阴历的命令行程序
包括: 除夕(Chinese New Year?s Day)、清明(Tomb-Sweeping Day)、端午(Dragon Boat Festival)、中秋(Mid-Autumn Festival)等传统节日，以及元旦、五一、十一、儿童节、教师节等。
dpkg -S file
pev winappfile.exe
$ pev /mnt/tmp/WINDOWS/explorer.exe
6.0.2900.5512
$pev /mnt/tmp/WINDOWS/system32/calc.exe
5.1.2600.0
pev - Extract PE(.exe) version information in bash
pev: PE version utility, to show the Product Version of compiled PE files
tarball: http://www.mentebinaria.com.br/coding40/pev-0.22.tar.gz
source: https://github.com/merces/pev
home: http://coding40.mentebinaria.com.br/projetos/pev
chage -d 0 -m 0 -M 60 [user]
How to expire the password to force her change [Linux]
This command is Linux compatible.
It will prompt the user for a new password at next logon
tcpdump | aplay -c 2
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth1, link-type EN10MB (Ethernet), capture size 65535 bytes
Playing raw data 'stdin' : Unsigned 8 bit, Rate 8000 Hz, Stereo
Functions: aplay tcpdump
Output sound when your computer is downloading something
Outputs pseudo-random sounds to speakers (stereo mode because of -c 2) when there are any kind of network activity.
ssh user@host "tar -czf - /path/to/dir" > dir.tar.gz
echo -n search\>\ ; read SEARCH_STRING && sed -n "/$SEARCH_STRING/{n;p;n;p;n;p;q}" [file-to-search]
$ echo -n search\>\ ; read SEARCH_STRING && sed -n "/$SEARCH_STRING/{n;p;n;p;n;p;q}" /etc/passwd
search> sshd
suse-ncc:x:105:107:Novell Customer Center User:/var/lib/YaST2/suse-ncc-fakehome:/bin/bash
uucp:x:10:14:Unix-to-Unix CoPy system:/etc/uucp:/bin/bash
uuidd:x:100:101:User for uuidd:/var/run/uuidd:/bin/false
Functions: echo read sed
Customizable Search Context
customizable context searches - if you know sed, this is a basis for more complex context control than grep --context offers
gconftool-2 --set "/system/http_proxy/use_http_proxy" --type boolean true
Activate the mandatory proxy under ubuntu
Solution to activate (or deactivate with false instead of true) the global mandatory proxy under Ubuntu (not tested elsewhere).
Others keys you can configure :
gconftool-2 --set "/system/http_proxy/host" --type string "
gconftool-2 --set "/system/http_proxy/port" --type int 8080
gconftool-2 --set "/system/http_proxy/ignore_hosts" --type list --list-type string ["localhost","127.0.0.1","*.local"]
gconftool-2 --set "/system/proxy/mode" --type string manual
nikto.pl -h yourwebserver
nikto.pl -h webserv
- Nikto v2.03/2.04
---------------------------------------------------------------------------
+ Target Hostname: wevserv
+ Server: Apache/2.2.0 (Fedora)
+ No CGI Directories found (use '-C all' to force check all possible dirs)
+ Apache/2.2.0 appears to be outdated (current is at least Apache/2.2.9). Apache 1.3.39 and 2.0.61 are also current.
+ OSVDB-877: TRACE / : TRACE option appears to allow XSS or credential theft. See http://www.cgisecurity.com/whitehat-mirror/WhitePaper_screen.pdf for details
+ 3577 items checked: 2 item(s) reported on remote host
+ 1 host(s) tested
Test Options: -h webserv
How to check webserver by Nikto
This is wonderful perl script to check the web server security and vulnerability .Get it from here :http://www.cirt.net/nikto2
Here are some key features of "Nikto":
? Uses rfp's LibWhisker as a base for all network funtionality
? Main scan database in CSV format for easy updates
? Determines "OK" vs "NOT FOUND" responses for each server, if possible
? Determines CGI directories for each server, if possible
? Switch HTTP versions as needed so that the server understands requests properly
? SSL Support (Unix with OpenSSL or maybe Windows with ActiveState's Perl/NetSSL)
? Output to file in plain text, HTML or CSV
? Generic and "server type" specific checks
? Plugin support (standard PERL)
? Checks for outdated server software
? Proxy support (with authentication)
? Host authentication (Basic)
? Watches for "bogus" OK responses
? Attempts to perform educated guesses for Authentication realms
? Captures/prints any Cookies received
? Mutate mode to "go fishing" on web servers for odd items
? Builds Mutate checks based on robots.txt entries (if present)
? Scan multiple ports on a target to find web servers (can integrate nmap for speed, if available)
? Multiple IDS evasion techniques
? Users can add a custom scan database
? Supports automatic code/check updates (with web access)
? Multiple host/port scanning (scan list files)
? Username guessing plugin via the cgiwrap program and Apache ~user methods
‹ First < 235 236 237 238 239 > Last ›
date +%A | cut -c $(( $(date +%A | wc -c) - 1 ))
Functions: cut date wc
Bash function to see what the day ends in
A command to find out what the day ends in. Can be edited slightly to find out what "any" output ends in.
NB: I haven't tested with weird and wonderful output.
ls -Xp /path/to/dir | grep -Eo "\.[^/]+$" | uniq
If we want files with more than one extension, like .tar.gz, only appear the latest, .gz:
ls -Xp /path/to/dir | grep -Eo "\.[^./]+$" | uniq
hexdump -e '8/1 "%02X ""\t"" "' -e '8/1 "%c""\n"' /dev/sda1 | less /mystring
Functions: hexdump less
find a particular string on an unmounted partition
dpkg -S locale.alias
for((r=1;r<10;r++));do v=1;echo -n "$v ";for((c=1;c<$r;c++));do v2=$(($(echo "$v*($r-$c)/$c")));echo -n "$v2 ";v=$v2;done;echo;done
1 1
1 2 1
1 3 3 1
1 4 6 4 1
1 5 10 10 5 1
1 6 15 20 15 6 1
1 7 21 35 35 21 7 1
1 8 28 56 70 56 28 8 1
Generate Pascal's Triangle
http://en.wikipedia.org/wiki/Pascal%27s_triangle
This one's for bartonski. Enjoy.
Note: after row 64 we overflow integer maths.
pwdadm -f ADMCHG [user]
How to expire the password to force her change [AIX]
This command is AIX compatible.
awk 'sub("$", "\r")' unixfile.txt > winfile.txt
unix2dos with awk
cat dirtyfile.txt | awk '{gsub(/[[:punct:]]/,"")}1' | tr A-Z a-z | sed 's/[0-9]*//g' | sed -e 's/ //g' | strings | tr -cs '[:alpha:]' '\ ' | sed -e 's/ /\n/g' | tr A-Z a-z | sort -u > cleanfile.txt
Functions: awk cat sed sort strings tr
Clean a wordlist for use with password cracking tools and rules
Using large wordlists is cumbersome. Using password cracking programs with rules such as Hashcat or John the ripper is much more effective. In order to do this many times we need to "clean" a wordlist removing all numbers, special characters, spaces, whitespace and other garbage. This command will covert a entire wordlist to all lowercase with no garbage.
netstat -plntu
Proto Recv-Q Send-Q Adresse locale Adresse distante Etat PID/Program name
Check open TCP and UDP ports
find . -newer /tmp/foo -exec touch --date "2011-12-12" {} \;
None. Check it with 'ls -al'
Modify all files newer than another file and touch them to a specific date.
manview() { lynx -dump -accept_all_cookies 'http://www.csuglab.cornell.edu/cgi-bin/adm/man.cgi?section=all&topic='"$1" | less; }
search manpages on the internets
manview searches man pages on the internets in case the man command doesn't work for some reason or if you think the man pages in Cornell's flavor of Solaris might differ from yours. It dumps the manpage info from lynx to less, so it ends up looking remarkably like a real manpage. Put it in your .bash_profile or .bashrc, and then you can use it like a regular command: typing "manview ssh" will give you the manpage for ssh.
( trap '' 1; ( nice -n 19 sleep 2h && command rm -v -rf /garbage/ &>/dev/null && trap 1 ) & )
Functions: command nice rm sleep trap
Schedule Nice Background Commands That Won't Die on Logout - Alternative to nohup and at
Check out the usage of 'trap', you may not have seen this one much. This command provides a way to schedule commands at certain times by running them after sleep finishes sleeping. In the example 'sleep 2h' sleeps for 2 hours. What is cool about this command is that it uses the 'trap' builtin bash command to remove the SIGHUP trap that normally exits all processes started by the shell upon logout. The 'trap 1' command then restores the normal SIGHUP behaviour.
It also uses the 'nice -n 19' command which causes the sleep process to be run with minimal CPU.
Further, it runs all the commands within the 2nd parentheses in the background. This is sweet cuz you can fire off as many of these as you want. Very helpful for shell scripts.
awk '{print NR,$0}'
df -kh /dev/vg0*/lv*
rdesktop -u -p -g 1366x724 -a 16 -D -z -P
The above command will:
- open a Remote Desktop connection to [servername / IP Address],
- authenticate using [username] and [password],
- configure resolution to best fit your desktop (I have a 1366x768px resolution so I left space for 2 panels of 22px each),
- sets the color depth for the connection to 16 bpp,
- hides the window manager decorations,
- enables compression of the RDP data stream,
- enables persistent bitmap caching.
curl -s http://twitter.com/users/show.xml?screen_name=username | sed -n 's/\//p' | sed 's/<[^>]*>//g;///p' | sed 's/<[^>]*>//g;/ mplayerfifo1 & crossfadeOut > mplayerfifo2
loop 0 10 > mplayer fifo1
etc etc
ping -a IP-ADDRESS
pcspkr have to be enabled!
modprobe pcspkr
xset b on
get_duration () { IFS=.: read -r _ h m s _ < <(ffmpeg -i "$1" 2>&1 | grep Duration);echo $(( h * 360 + m * 60 + s )); }
Functions: echo grep read
‹ First < 236 237 238 239 240 > Last ›
git config --global alias.log1 "log --pretty=oneline --abbrev-commit"
% git log1
45c82b5... Merge branch 'header-fixes-for-linus'
git log1 alias
This command limits the oputut of git log to one-line per commit and an abbreviated commit ID.
watch -d "free -mt"
what the free memory grow or shink
on="off"; off="on"; now=$(amixer get Master | tr -d '[]' | grep "Playback.*%" |head -n1 |awk '{print $7}'); amixer sset Master ${!now}
Functions: amixer get grep tr
I've had this as mute.sh in my ~/bin/ for some time.
tcpdump -i eth0 "tcp port pop3 and ip[40] = 85 and ip[41] = 83" -s 1500 -n -w "sniff"
USER username@maildomain.com
The command is useful for monitoring the use of the boxes and their connection IP.
Result file "sniff" is readable with GUI program "wireshark" or through CLI with the command:
tcpdump -f "sniff" -XX
shopt -s nullglob; for i in $(find "Your/file/system" -name "*.pdf"); do e="$(dirname $i)/$(basename $i '.pdf').png"; gs -sDEVICE=png16m -q -dPDFFitPage -g492x380 -dTextAlphaBits=4 -dGraphicsAlphaBits=4 -dNOSUBSTDEVICECOLORS -o $e $i; done
Functions: find gs
Convert a directory of pdfs into scaled down pngs
Using ghostscript instead of imagemagick to convert pdfs into pngs. It keeps pngs with pdfs
find src/ -name "*.java" | while read f; do echo -n "$f "; cat "$f" | tr -dc '{}'; echo; done | awk '{ print length($2), $1 }' | sort -n
Functions: awk cat echo find read sort tr
Find .java files with high complexity (counting curly braces)
sed ':a;N;$!ba;s/\n\n/\n%\n/g' input.txt >output
Create fortune's *.dat file from commandlinefu from saved preferite
Create fortune's *.dat file from commandlinefu from saved preferite script by suhasgupta (http://www.commandlinefu.com/commands/view/3681/backup-all-your-commandlinefu.com-favourites-to-a-plaintext-file) - Italian tutorial here: http://mrehqe.blogspot.com/2011/11/come-ottenere-un-commandlinefu-della.html
ps -ef | grep [t]clsh
Grep the process excluding the grep itself.
perl -pe 'print "$. "'
No need $_ netp ;)
xdg-open $(ls . | dmenu)
File browser
Simple file browser with dmenu, ls, and xdg-open.
$ echo "command"; `!#:0-$
$ echo "ls"; `!#:0-$
echo "ls"; `echo "ls" ; `
Android.mk ardrv devmgr egl file1
since we're repeating the command there after the semicolon, we only need one backtick
fail () { ln -s /nonexistent 0_FAIL_${1}; }
Mark a directory as one where something failed
If you use colored ls(1), the broken symbolic links significantly differ from regular files and directories in the ls listing. In my case it is bright red. 0 is for getting the first place in the list.
find `pwd` -maxdepth 1 -exec ls --color -d {} \;
/usr/local/bin/OFPW -mode 1
set open firmware password command mode
Sets the Open Firmware to ask for password when selecting a boot volume other then the hd
svn st | grep ^? | xargs svn add 2> /dev/null
Add all not commited files to svn
diff <(nmap -sP 192.168.1.0/24 | grep ^Host | sed 's/.appears to be up.//g' | sed 's/Host //g') auth.hosts | sed 's/[0-9][a-z,A-Z][0-9]$//' | sed 's/ Last ›
ls *.JPG | cut -d . -f 1 | xargs -L1 -i convert -resize 684 {}.JPG {}.jpg
Functions: cut ls xargs
cat tarfile.tar.gz | ssh server.com " cd /tmp; tar xvzf - directory/i/want"
Untar a directory in a tar file over ssh
This may be listed already but this command is useful to untar a specific directory to a different server.
df -h | grep -v ^none | ( read header ; echo "$header" ; sort -rn -k 5)
/dev/sdc1 1.4T 403G 904G 31% /data
Functions: df echo grep read sort
df output, sorted by Use% and correctly maintaining header row
Show disk space info, grepping out the uninteresting ones beginning with ^none while we're at it.
The main point of this submission is the way it maintains the header row with the command grouping, by removing it from the pipeline before it gets fed into the sort command. (I'm surprised sort doesn't have an option to skip a header row, actually..)
It took me a while to work out how to do this, I thought of it as I was drifting off to sleep last night!
seq 1 255 | parallel -j+0 'nc -w 1 -z -v 192.168.1.{} 80'
port scan using parallel
It takes over 5 seconds to scan a single port on a single host using nmap
time (nmap -p 80 192.168.1.1 &> /dev/null)
real 0m5.109s
user 0m0.102s
sys 0m0.004s
It took netcat about 2.5 minutes to scan port 80 on the class C
time (for NUM in {1..255} ; do nc -w 1 -z -v 192.168.1.${NUM} 80 ; done &> /dev/null)
real 2m28.651s
user 0m0.136s
sys 0m0.341s
Using parallel, I am able to scan port 80 on the entire class C in under 2 seconds
time (seq 1 255 | parallel -j255 'nc -w 1 -z -v 192.168.1.{} 80' &> /dev/null)
real 0m1.957s
user 0m0.457s
sys 0m0.994s
mencoder vcd://2 -o sample.avi -oac copy -ovc lavc -lavcopts vcodec=mpeg4
Convert vcd to avi format
Convert VCD to .AVI
(echo -e '\xfe'; sleep 1) |telnet -L $HOSTIP 25565 2>/dev/null |awk -F'\xa7' '$2 {print "users: "$2"/"$3;}'
users: 12/30
Functions: awk echo sleep telnet
Get number of users on a minecraft server
I'm flat-out surprised that minecraft directory services require servers install multiple modifications to their server code, when the directories could fetch this information on their own.
for i in `netstat -rn|egrep -v "Interface|Routing"|awk '{print $5}'`;do ifconfig $i;done
lo0: flags=849
lan7: flags=1843
lan1:1: flags=1843
lan2: flags=1843
Functions: awk egrep ifconfig
Command is properly working on HP-UX 11.31
toilet -f big ReadMe
_____ _ __ __
| __ \ | | \/ |
| |__) |___ __ _ __| | \ / | ___
| _ // _ \/ _` |/ _` | |\/| |/ _ \
| | \ \ __/ (_| | (_| | | | | __/
|_| \_\___|\__,_|\__,_|_| |_|\___|
Need an ascii art font for you readme text ?
need toilet package , same goes for figlet
showfigfonts | less : give the list of font available for options
date -s "$(echo -e "HEAD / HTTP/1.0\n" | nc www.example.com 80 | sed -ne 's/^Date: \(.*\)$/\1/p')"
Poor man's ntpdate
Good when firewalled and only in need of a reasonable accurate time.
Use a fast responding web server.
setopt shwordsplit
zsh variable behave like bash variable
for exemple :
var="echo hello"; $var
this will display "hello" with bash
with zsh, by default, this will make an error :
"command not found : echo hello"
hwordsplit option permit zsh to act like bash on this point
curl -sL 'www.commandlinefu.com/commands/random' | awk -F']+>' '/"command"/{print $2}'
Splitting on tags in awk is a handy way to parse html.
rsync -avz --dry-run --include="only-include-this-filename" -f 'hide,! */' source/folder/ target/folder/
rsync a hierarchy but matching only one filename
Applying filter rules is what makes this a really useful command. It's usually a pain to figure out how to sync ONLY files matching a particular pattern, and often one reverts to goofy stuff like find .. -exec rsync ..
The filter hides all folders from the transfer, so that only the matching folders that store the filename are left for the sync.
nmap -sT -PN -vv
Starting Nmap 5.00 ( http://nmap.org ) at 2011-07-21 19:21 PDT
NSE: Loaded 0 scripts for scanning.
Initiating Connect Scan at 19:21
Scanning localhost (127.0.0.1) [1000 ports]
Discovered open port 111/tcp on 127.0.0.1
Discovered open port 993/tcp on 127.0.0.1
Discovered open port 25/tcp on 127.0.0.1
Discovered open port 995/tcp on 127.0.0.1
Discovered open port 113/tcp on 127.0.0.1
Discovered open port 143/tcp on 127.0.0.1
Discovered open port 21/tcp on 127.0.0.1
Discovered open port 110/tcp on 127.0.0.1
Discovered open port 22/tcp on 127.0.0.1
Discovered open port 1984/tcp on 127.0.0.1
Discovered open port 465/tcp on 127.0.0.1
Discovered open port 5432/tcp on 127.0.0.1
Discovered open port 3333/tcp on 127.0.0.1
Discovered open port 10025/tcp on 127.0.0.1
Discovered open port 8333/tcp on 127.0.0.1
Discovered open port 10024/tcp on 127.0.0.1
Discovered open port 2401/tcp on 127.0.0.1
Completed Connect Scan at 19:21, 0.14s elapsed (1000 total ports)
Host localhost (127.0.0.1) is up (0.00092s latency).
Scanned at 2011-07-21 19:21:55 PDT for 0s
Interesting ports on localhost (127.0.0.1):
Not shown: 983 closed ports
PORT STATE SERVICE
21/tcp open ftp
22/tcp open ssh
25/tcp open smtp
110/tcp open pop3
111/tcp open rpcbind
113/tcp open auth
143/tcp open imap
465/tcp open smtps
993/tcp open imaps
995/tcp open pop3s
1984/tcp open bigbrother
2401/tcp open cvspserver
3333/tcp open dec-notes
5432/tcp open postgresql
8333/tcp open unknown
10024/tcp open unknown
10025/tcp open unknown
Read data files from: /usr/share/nmap
Nmap done: 1 IP address (1 host up) scanned in 0.23 seconds
Nmap find open TCP/IP ports for a target that is blocking ping
Change the IP address from 127.0.0.1 to the target machines ip address. Even if the target has ICMP (ping) blocked, it will show you what ports are open on the target. Very handy for situations where you know the target is up and online but wont respond to pings.
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
This option selects the listing of all Internet and x.25 (HP-UX) network files.
mate - `find * -type f -regex 'REGEX_A' | grep -v -E 'REGEX_B'`
Open in TextMate Sidebar files (recursively) with names matching REGEX_A and not matching REGEX_B
This does the following:
1 - Search recursively for files whose names match REGEX_A
2 - From this list exclude files whose names match REGEX_B
3 - Open this as a group in textmate (in the sidebar)
And now you can use Command+Shift+F to use textmate own find and replace on this particular group of files.
For advanced regex in the first expression you can use -regextype posix-egrep like this:
mate - `find * -type f -regextype posix-egrep -regex 'REGEX_A' | grep -v -E 'REGEX_B'`
Warning: this is not ment to open files or folders with space os special characters in the filename. If anyone knows a solution to that, tell me so I can fix the line.
for i in *.avi; do echo -n "$i:";mediainfo $i|head | grep PlayTime | cut -d: -f2 ; done | sort -t: -k2 -r
Functions: cut echo grep head sort
Similar but using mediainfo instead of totem-something
find /usr/share/figlet -name *.?lf -exec basename {} \; | sed -e "s/\..lf$//" | xargs -I{} toilet -f {} {}
+-+-+-+-+-+-+-+
|d|i|g|i|t|a|l|
, __ ,_ _ _|_
/ \_/ / | | |/ \_|
\/ \___/ |_/|_/|__/ |_/
Functions: basename find sed xargs
Show demo of toilet fonts
Lists a sample of all installed toilet fonts
findlocation() {place=`echo $@`; lynx -dump "http://maps.google.com/maps/geo?output=json&oe=utf-8&q=$place" | egrep "address|coordinates" | sed -e 's/^ *//' -e 's/"//g' -e 's/address/Full Address/';}
$ : distance 1600 Pennsylvania Avenue, Washington D.C
Full Address: 1600 Pennsylvania Ave NW, Washington D.C., DC 20500, USA,
coordinates: [ -77.0365191, 38.8976964 ]
Just a few minor changes.
First the usage of lynx instead of curl so no sed is needed to revert the spaces. Then the usages of egrep instead of grep -e to save a few characters and last the removal of the extra 0.
find . -name "*.cpp" -exec grep -Hn --color=tty -d skip "main" {} \;
Find the main file :D
gpg --list-sigs | sed -rn '/User ID not found/s/^sig.+([a-FA-F0-9]{8}).*/\1/p' | xargs -i_ gpg --keyserver-options no-auto-key-retrieve --recv-keys _
Functions: gpg sed xargs
Fetch all GPG keys that are currently missing in your keyring
For instance, if people have signed your key, this will fetch the signers' keys.
sw_vers
Show Mac OS X version information
eog $(find $HOME -iname ExamplePicture*.jpg)
Find a .jpg in Your Home-Directory and display it via eog. Not case sensitive.....
echo -n 'text' | xxd -ps | sed 's/[[:xdigit:]]\{2\}/\\x&/g'
Same as another one I saw, just with a cleaner sed command
Edit: updated the sed command to use the [[:xdigit:]] character class - more portable between locales
Note that it will have a newline inserted after every 32 characters of input, due to the output of xxd
alias cd1='cd $( ls -1t | grep ^d | head -1)'
Functions: alias grep head ls
mencoder -aid 2 -oac copy file.avi -o english.mp3
Extract an audio track from a multilingual video file, for a specific language.
‹ First < 238 239 240 241 242 > Last ›
ditto --arch i386 doubleTwist.app doubleTwist_i386.app
remove unnecessary architecture code from Mac OS X Universal binaries
ditto can be used to "thinnify" Mach-O Universal binaries to separate unncessary code from your machine. For example, doubleTwist.app shaved off around 10 MB while Google Earth went from 112 MB to 62 MB after extracting only the i386 code from them.
gst-launch-0.10 autovideosrc ! video/x-raw-yuv,framerate=\(fraction\)30/1,width=640,height=480 ! ffmpegcolorspace ! autovideosink
View webcam output using GStreamer pipeline
Open a window that displays camera capture.
Framerate, width and height may be changed to match your needs.
date -s "`curl -sI www.example.com | sed -n 's/^Date: //p'`"
If you don't have netcat, you can use curl.
read -p "enter url:" a ; w3m -dump $a > /dev/shm/e1q ; less /dev/shm/e1q ; read -p "save file as text (y/n)?" b ; if [ $b = "y" ] ; then read -p "enter path with filename:" c && touch $(eval echo "$c") ; mv /dev/shm/e1q $(eval echo "$c") ; fi ; echo DONE
*(me)*@ubuntu:~$ read -p "enter url:" a ; w3m -dump $a > /dev/shm/e1q ; less /dev/shm/e1q ; read -p "save file as text (y/n)?" b ; if [ $b = "y" ] ; then read -p "enter path with filename:" c && touch $(eval echo "$c") ; mv /dev/shm/e1q $(eval echo "$c") ; fi ; echo DONE
enter url:www.google.com
save file as text (y/n)?y
enter path with filename:~/this
*(me)*@ubuntu:~$
Functions: c++ echo eval less mv read touch
Get a url, preview it, and save as text - with prompts
Thanks th John_W for suggesting the fix allowing ~/ to be used when saving a directory.
directions:
Type in a url, it will show a preview of what the file will look like when saved, then asks if you want to save the preview and where you want to save it. Great for grabbing the latest commandlinefu commands without a full web browser or even a GUI. Requires: w3m
equery belongs $( which mv )
Functions: mv which
Find the package a command belongs to on Gentoo
find / -type f -size +20000k -exec ls -lh {} \; | awk '{printf $9} {for (i=10;i<=NF;i++) {printf " "$i}} {print ": "$5}'
Find all files over 20MB and print their names and size in human readable format
eval "mkdir test{$(seq -s, 1 10)}"
Overcome Bash's expansion order
In order to create, let's say, 10 directories with a single process we can use the command:
mkdir test{1,2,3,4,5,6,7,8,9,10}
something extremely boring to type! Why not use seq?
seq -s, 1 10
and use its output inside the curly braces?
The obvious solution
mkdir test{$(seq -s, 1 10)}
is, unfortunately, too naive and doesn't work. The answer is the order of the shell expansions (feature of Bourne Shell, actually), where brace expansion happens before command substitution (according to Bash's manual).
The solution is to put another level of substitution, using the powerful and mystic command eval.
I found the trick in a similar problem in the post at http://stackoverflow.com/questions/6549037/bash-brace-expansion-in-scripts-not-working-due-to-unwanted-escaping
seq 20 | sed '5,6 { w out.txt }' #Can't print correctly. See sample output
$ seq 20 | sed -n '5,6 { w out.txt
}'
$ cat out.txt
Functions: sed seq
Read/Write output/input from sed to a file
Can't print correctly in the command field.
There is a new line before } as follows
seq 20 | sed -n '5,6 { w out.txt
}'
xml fo -e utf-8 file.xml | xml esc
fomat/encode/escape xml
gnu@robby:/tmp$ set -o noclobber
gnu@robby:/tmp$ cat tesk
dffd
gnu@robby:/tmp$ cat > tesk
bash: tesk : impossible d'?craser le fichier existant
gnu@robby:/tmp$ cat >> tesk
fdf
gnu@robby:/tmp$
Prevent overwriting file when using redirection
If you set noclobber to on, bash won't allow redirection to overwrite existing files .
set -o noclobber command turn the option on (default it s off ) .
You can still append information but not overwrite the file .to turn it back off use : $ set +o noclobber .
I use it because i overwrite a file by accident , after thought , content of the file was very important , creating a one more file mean nothing for my hard disk (we are not anymore on the 64 k memory time) , but content of file is far much important . What we call exeprience :(
git log -g --pretty=oneline | grep '}: commit' | awk '{print $1}' | head -1 | xargs git checkout -f
Functions: awk grep head xargs
nvidia-settings -a AssociatedDisplays=0x00010000
Attribute 'AssociatedDisplays' (legerdemain:0.0) assigned value 65536.
fix nvidia-settings display error
When nvidia-settings gets itself into a funk and displays the error
"Unable to load X Server Display Configuration page", then use
this script to make it reset itself.
reference: http://ubuntuforums.org/archive/index.php/t-1047029.html
du -h / | grep -w "[0-9]*G"
vie(){vi $(which $1)}
edit a executable script
vie myscript
will find where myscript is, and then use vi to edit that file. Not much trick, but saves typing if you use it a lot.
curl --cookie name= --data-urlencode name=my_post_key=\&delete=1\&submit=Delete+Now\&action=deletepost\&pid=$c --user-agent Firefox\ 3.5 --url http://url/editpost.php?my_post_key=\&delete=1\&submit=Delete+Now\&action=dele
As a user, deletes all your posts from a MyBB board (provided you have the search page listings of all your posts saved into the same directory this command is run from). Full command:
for i in *; do cat $i | grep pid | sed -e 's/;/\ /g' -e 's/#/\ /g' -e 's/pid=/\ /g' | awk -F ' ' '{print $2}' >> posts.txt; done; for c in `cat posts.txt`; do curl --cookie name= --data-urlencode name=my_post_key=\&delete=1\&submit=Delete+Now\&action=deletepost\&pid=$c --user-agent Firefox\ 3.5 --url http://url/editpost.php?my_post_key=\&delete=1\&submit=Delete+Now\&action=deletepost\&pid=$c; sleep 2s; done; echo
grep -i -f password_tokens sslstrip.log | awk ' BEGIN { RS="&" } { print $1 }' | grep -i -f tokens_file
Export usernames and passwords from sslstrip log
SIZE=`fdisk -s /dev/sdx`; dd if=/dev/sdx bs=1M | pv -s "$SIZE"k > hdd.img
dd with progress bar and remaining time displayed
ssh @ 'mkdir -m 700 ~/.ssh; echo ' $(< ~/.ssh/id_rsa.pub) ' >> ~/.ssh/authorized_keys ; chmod 600 ~/.ssh/authorized_keys'
Functions: chmod echo ssh
Creates the .ssh directory on the remote host with proper permissions, if it doesnt exist. Appends your public key to authorized_keys, and verifies it has proper permissions. (if it didnt exist it may have been created with undesireable permissions).
*Korn shell syntax, may or may not work with bash
/usr/sbin/httpd -l
Compiled in modules:
core.c
prefork.c
http_core.c
mod_so.c
See whether your compiled Apache is prefork or worker MPM
For some of my web servers I setup and configure, for scaling I use the httpd.conf settings for these. Sometimes I forget which servers are prefork and which are worker MPM, so I use this to remind myself.
ps -L -p | wc -l
Get thread count for process on Solaris
echo -e ${PATH//:/\\n} | less
/home/nicoulaj/bin
pack.sh -domain=[PATH]/domains/mydomain -template=[PATH]/mydomain.jar -template_name="mydomain"
pack.sh -domain=[PATH]/domains/mydomain -template=[PATH]/mydomain.jar -template_name="mydomain"
<< read domain from "[PATH]/domains/mydomain"
>> succeed: read domain from "[PATH]/domains/mydomain"
<< write template to "[PATH]/mydomain.jar"
....................................................................................................
>> succeed: write template to "[PATH]/mydomain.jar"
<< close template
>> succeed: close template
Create a template for WebLogic 9 or 10
seq 8 | awk '{print "e(" $0 ")" }' | bc -l
2.71828182845904523536
7.38905609893065022723
20.08553692318766774092
54.59815003314423907811
148.41315910257660342111
403.42879349273512260838
1096.63315842845859926372
2980.95798704172827474359
Functions: awk bc seq
If you want a sequence that can be plotted, do:
seq 8 | awk '{print "e(" $0 ")" }' | bc -l | awk '{print NR " " $0}'
Other bc functions include s (sine), c (cosine), l (log) and j (bessel). See the man page for details.
sed 's/^\(.*\)\(.\)\(.\)$/\1\3/' fileName
to display all characters except second last character from each line of a file
wget -O/dev/sdb ftp://ftp.debian.org/debian/dists/stable/main/installer-amd64/current/images/netboot/mini.iso
Write a bootable Linux .iso file directly to a USB-stick
This wgets the iso directly to the USB device, replace /dev/sdb with the device name of the USB stick. After wget finishes you will be able to boot the .iso file from the USB stick.
‹ First < 239 240 241 242 243 > Last ›
debconf-copydb configdb copydb --pattern= --config="Name: copydb" --config="Driver: File" --config="Filename: ~/copydebconf.dat"
Save the debconf configuration of an installed package
for I in $(echo "show tables" | mysql -u `; do echo "ALTER TABLE $I ENGINE = INNODB"| mysql -u ; done
convert myisam to innodb
Convert all Tables from MyISAM to InnoDB
dd if=/dev/urandom bs=16 count=1 2>/dev/null | base64
a5sXvbJx0pUY/CEuxwM4YA==
Create a hard-to-guess password
Alternatively, if your password can contain a richer character set, try using 'uuencode' rather than base64.
dd if=/dev/urandom bs=16 count=1 2>/dev/null | uuencode -
Sample of that: '0:.CF\-@"\`W315VG^4O\.@``'
find /home/fizz -type f -printf '%TY-%Tm-%Td %TT %p\n' | sort
List files recursively sorted by modified time
wget -q -O - 'URL/full?orderby=starttime&singleevents=true&start-min=2009-06-01&start-max=2009-07-31' | perl -lane '@m=$_=~m/(.+?)</g;@a=$_=~m/startTime=.(2009.+?)T/g;shift @m;for ($i=0;$i<@m;$i++){ print $m[$i].",".$a[$i];}';
Claudio,2009-07-30
Claudio,2009-07-23
Claudio,2009-07-17
Claudio,2009-07-16
Claudio,2009-07-10
Claudio,2009-07-03
Claudio,2009-07-02
Claudio,2009-06-26
Claudio,2009-06-25
Failure,2009-06-20
Glconsulting,2009-06-18
Failure,2009-06-15
production migration,2009-06-08
get events from google calendar for a given dates range
substitute the URL with your private/public XML url from calendar sharing settings
substitute the dates YYYY-mm-dd
adjust the perl parsing part for your needs
unpack.sh -domain=[PATH]/domains/mydomain -template=[PATH]/mydomain.jar
<< read template from "[PATH]/mydomain.jar"
>> succeed: read template from "[PATH]/mydomain.jar"
<< write Domain to "[PATH]/domains/mydomain"
>> warning:write Domain to "[PATH]/domains/mydomain"
>> The "JDBC" configuration in your domain has been found to be invalid. It may be possible to resolve the issue by reviewing your script. The wizard will continue, but you may want to start the server in your domain and review the messages displayed to identify the invalid configuration.
...............................................................................................
>> succeed: write Domain to "[PATH]/domains/mydomain"
Unpack and build a WebLogic 9 or 10 domain
fname=$1;f=$(ls -la $fname);fsz=$(echo $f|awk '{ print $5 }');nrrec=$(wc -l $fname|awk '{ print $1 }');recsz=$(expr $fsz / $nrrec);echo "$recsz"
0 if the file is 0-length
<integer> if the file is not 0-length
file <fname> does not exist (on stderr) if file does not exist
Functions: awk echo expr ls wc
give record size of given record-structured file
command was too long...
this is the complete command:
fname=$1; f=$( ls -la $fname ); if [ -n "$f" ]; then fsz=$( echo $f | awk '{ print $5 }' ); if [ "$fsz" -ne "0" ]; then nrrec=$( wc -l $fname | awk '{ print $1 }' ); recsz=$( expr $fsz / $nrrec ); echo "$recsz"; else echo "0"; fi else echo "file $fname does not exist" >&2; fi
First the input is stored in var $fname
The file is checked for existance using "ls -lart".
If the output of "ls -lart" is empty, the error message is given on stderr
Otherwise the filelength is taken from the output of "ls -lart" (5th field)
With "wc -l" the number of records (or lines) is taken.
The record size is filelength devided by the number of records.
please note: this method does not take into account any headers, variable length records and only works on ascii files where the records are sperated by 0x0A (or 0x0A/0x0D on MS-DOS/Windows).
debconf-copydb copydb configdb --config="Name: copydb" --config ="Driver: File" --config="Filename: ~/copydebconf.dat"
Import a debconf configuration (from a copydebconf.dat file)
mplayer -cache 100 -dumpstream http://listen.di.fm/public3/drumandbass.pls -dumpfile music.mp3
Rip from mp3 stream mplayer
You wont hear anything when you run that command.
You must run:
mplayer music.mp3
YOU NEED MPLAYER
sudo apt-get install mplayer
convert panorama_rainbow_2005.jpg -resize 40% panorama_rainbow_compress.jpg
Command line invocation of ImageMagick to resize a file
convert -resize 750?500 -quality 80% *.jpg
These are command-line invocations of ImageMagick functions. The first sizes an image file to 40% of original and saves it to a different name, while the second makes all jpg files in a directory sized to 750x500 pixels. Such a pleasure not to need to point and click to make a bunch of thumbnails -- for example.
ffmpeg -i "/path/to/file.mp4" "/path/to/file.avi"
convert a .mp4 to a .avi
sed 's/,/\t/g' report.csv > report.tsv
Convert CSV files to TSV
Convert comma separated files to tab separated files.
(MySQL eats tab separated files with much less instruction than comma seperated files.)
pattern='regexp_pattern'; find . -type f -perm +220 ! -name '*.bak' -print0 | xargs -0 egrep -lZ $pattern | xargs -0 sed -i.bak -e "/$pattern/d"
Functions: egrep find sed xargs
Remove lines matching a pattern in files (backup any modified files)
cat /etc/apache2/sites-enabled/* | egrep 'ServerAlias|ServerName' | tr -s " " | sed 's/^[ ]//g' | uniq | cut -d ' ' -f 2 | sed 's/www.//g' | sort | uniq
Functions: cat cut egrep sed sort tr uniq
Get a list of all the unique hostnames from the apache configuration files. Handy to see what sites are running on a server.
man !!
tr A-Z a-z | tr -d 0-9\[\],\*-.?\:\"\(\)#\;\<\>\@ | tr ' /_' '\n' | sort | uniq -c
export GREP_OPTIONS='--color=auto'
Enable color pattern match highlighting in grep(1)
This will affect all invocations of grep, even when it is called from inside a script.
ack-open () { local x="$(ack -l $* | xargs)"; if [[ -n $x ]]; then eval vim -c "/$*[-1] $x"; else echo "No files found"; fi }
Functions: echo eval vim
Opens files containing search term in vim with search term highlighted
Takes the same arguments that ack does. E.g. ack-open -i "searchterm" opens all files below the current directory containing the search term. The search term is also highlighted within vim if you have hlsearch set. Works on zsh, unsure if it works on bash.
Note: ubuntu users have to change ack to ack-grep unless you already have it aliased (as I do)
ffmpeg -i movie.avi -s 320x240 -b 1000k -vcodec wmv2 -ar 44100 -ab 56000 -ac 2 -y movie.wmv
Convert AVI to WMV
I used this to cut down the file size of a 1gb .avi to about 200mb without sacrificing much quality.
echo "${STRING}" | tr '[A-Z]' '[a-z]' | awk '{print toupper(substr($0,1,1))substr($0,2);}'
$ (STRING="COmManDLinEfU"; echo "${STRING}" | tr '[A-Z]' '[a-z]' | awk '{print toupper(substr($0,1,1))substr($0,2);}')
Commandlinefu
Functions: awk echo tr
String Capitalization
Helpful when we want to do mass file renaming(especially mp3s).
curl -s http://tinyurl.com/create.php?url=$1 \ | sed -n 's/.*\(http:\/\/tinyurl.com\/[a-z0-9][a-z0-9]*\).*/\1/p' \ | uniq ; curl -s http://bit.ly/?url=$1 \ | sed -n 's/.*\(shortened-url"...............
Functions: sed uniq
This command will shorten any URL the user inputs. What makes this command different is that it utilizes 5 different services and gives you 5 different outputs.
This command will shorten any URL the user inputs. What makes this command different is that it utilizes 5 different services and gives you 5 different outputs: is.gd, bit.ly, u.nu, geekology.co.za, and tinyurl.
curl -s http://tinyurl.com/create.php?url=$1 \ | sed -n 's/.*\(http:\/\/tinyurl.com\/[a-z0-9][a-z0-9]*\).*/\1/p' \ | uniq ; curl -s http://bit.ly/?url=$1 \ | sed -n 's/.*\(shortened-url" value="http:\/\/bit.ly\/[a-zA-Z0-9][a-zA-Z0-9]*\).*/\1/p' \ | sed -n 's/.*\(http:\/\/bit.ly\/[a-zA-Z0-9][a-zA-Z0-9]*\).*/\1/p' \ | uniq ; curl -s http://geekology.co.za/shortii/create.php?u=$1 \ | sed -n 's/.*\(http:\/\/geekology.co.za\/[a-z0-9][a-z0-9]*\).*/\1/p' \ | uniq ; curl -s http://u.nu/unu-api-simple?url=$1 \ | sed -n 's/.*\(http:\/\/u.nu\/[a-z0-9][a-z0-9]*\).*/\1/p' \ | uniq ; curl -s http://is.gd/api.php?longurl=$1 \ | sed -n 's/.*\(http:\/\/is.gd\/[a-z0-9][a-z0-9]*\).*/\1/p' \ | uniq echo ""
ls | grep '^[A-Z0-9]*$'
7FILESTARTWITHNUMBER
AUTHORS
CODING
COPYING
FAQ
INSTALL
MYTEST1
NEWS
NUM2INBETWEEN
README
TODO
List only those files that has all uppercase letters in their names (e.g. README)
Some source package have many 'README' kind of files, among many other regular files/directories. This command could be useful when one wants to list only 'README' kind of files among jungle of other files. (e.g. I came across this situation after downloading source for module-init-tools)
Warning: This command would miss a file like => README.1 (or one with spaces in-between)
Corrections welcome.
cd /etc/network/if-up.d && iptables-save > firewall.conf && echo -e '#!/bin/sh -e\niptables-restore < $(dirname $0)/firewall.conf' > iptables && chmod a+x iptables
Functions: cd chmod dirname echo iptables iptables-save
Should run with sudo
zgrep CONFIG_MAGIC_SYSRQ /proc/config.gz
Figure out if your kernel has an option enabled
zless /proc/config.gz
curl www.whatismyip.org
11.22.33.44
External IP
Simple external IP checker, there are many on here but this one works and seems to be the shortest option I can find.
‹ First < 240 241 242 243 244 > Last ›
find $PWD -exec rpm --query -f {} \; | sort -u | grep -v "not owned"
Functions: find grep rpm sort
List RPM packages installed in current tree
shows all RPMs with files in the current directory & its subdirectories.
for host in *; do { if [ -d $host ]; then { cd ${host}; for share in *; do { if [ -d $share ]; then { cd $share; rsync -av --delete rsyncuser@$host::$share . 2>../$share.err 1>../$share.log; cd ..; }; fi; }; done; cd ..; }; fi; }; done;
Functions: cd host rsync
traverses directories of $host and $share to created a unified place for rsync backups
traverses e.g. "/data/myhost1.com/myrsyncshare"; logs stderr and stdout. useful with cron.
xe(){ curl "http://www.xe.com/wap/2co/convert.cgi?Amount=$1&From=$2&To=$3" -A "Mozilla" -s | sed -n "s/.*>\(.*\) $3<.*/\1/p";}
$ xe 123 SGD HUF
19,189.67
Currency converter using xe.com
It runs on Mac OS X since it has curl installed by default.
On Linux the easiest is to install curl, but wget -qU "Mozilla" "http..." will work too.
It's important to specify the currencies in capital letters, or use
sed -n "s/.*>\(.*\) `echo $3 | tr '[a-z]' '[A-Z]'`
sed -n "s/.*>\(.*\) $3
head -n1 sample.txt | tail -n1
Functions: head tail
Extract specific lines from a text file using Stream Editor (sed)
You can actually do the same thing with a combination of head and tail. For example, in a file of four lines, if you just want the middle two lines:
head -n3 sample.txt | tail -n2
Line 1 --\
Line 2 } These three lines are selected by head -n3,
Line 3 --/ this feeds the following filtered list to tail:
Line 4
Line 1
Line 2 \___ These two lines are filtered by tail -n2,
Line 3 / This results in:
Line 2
Line 3
being printed to screen (or wherever you redirect it).
mplayer -playlist <(find "$PWD" -type f)
Play all files in the directory using MPlayer
Skip forward and back using the < and > keys. Display the file title with I.
function say { mplayer -really-quiet "http://translate.google.com/translate_tts?tl=en&q=$1"; }
The output should be heard over your headphones or speakers. You might also see warning messages from mplayer, but they can be ignored:
Have Google Translate speak to you using your local speakers
Put the string above in your ~/.bashrc or ~/.bash_profile, then source the file. Make sure your sound output is working, you have mplayer installed, then type in a word or sentence similar to below:
say "why won't anyone talk to me?"
It's easy to get the language to be different by changing the "en" in the string to be "de" or some other language that Google Translate supports. Have multiple "say" functions, like "say-en" "say-de", etc.
rpm --query --filesbypackage [packagename]
List files in an RPM package
ps -ef | grep user | awk '{print $2}' | while read pid; do echo $pid ; pfiles $pid| grep portnum; done
Functions: awk echo grep ps read
Find which process is using a port on Solaris
My old Solaris server does not have lsof, so I have to use pfiles.
netstat -in
printf $(( echo "obase=16;$(echo $$$(date +%s%N))"|bc; ip link show|sed -n '/eth/ {N; p}'|grep -o -E '([[:xdigit:]]{1,2}:){5}[[:xdigit:]]{1,2}'|head -c 17 )|tr -d [:space:][:punct:] |sed 's/[[:xdigit:]]\{2\}/\\x&/g')|sha1sum|head -c 32; echo
7d9afbd91e49e265841c0d6c953e964a
Functions: echo grep head link printf sed tr
Generate an over-the-top UUID
first off, if you just want a random UUID, here's the actual command to use:
uuidgen
Your chances of finding a duplicate after running this nonstop for a year are about the same as being hit by a meteorite before finishing this sentence
The reason for the command I have is that it's more provably unique than the one that uuidgen creates. uuidgen creates a random one by default, or an unencrypted one based on time and network address if you give it the -t option.
Mine uses the mac address of the ethernet interface, the process id of the caller, and the system time down to nanosecond resolution, which is provably unique over all computers past, present, and future, subject to collisions in the cryptographic hash used, and the uniqueness of your mac address.
Warning: feel free to experiment, but be warned that the stdin of the hash is binary data at that point, which may mess up your terminal if you don't pipe it into something. If it does mess up though, just type
svn list -vR svn://server/repo/somedir | awk '{if ($3 !="") sum+=$3; i++} END {print "\ntotal size= " sum/1024000" MB" "\nnumber of files= " i/1000 " K"}'
total size= 3659.06 MB
number of files= 29.044 K
find both total size and number of files below any given svn directory
afaik, svn doesn't have a good, scriptable way of telling you these two basic pieces of information.
qdbus org.kde.krunner_lock /MainApplication quit; qdbus org.kde.plasma-overlay /MainApplication quit
Unlock your KDE4 session remotely (for boxes locked by KDE lock utility)
For KDE 4.2.* with plasma overlay activated I use this.
echo $(( `ulimit -u` - `find /proc -maxdepth 1 \( -user $USER -o -group $GROUPNAME \) -type d|wc -l` ))
See how many more processes are allowed, awesome!
There is a limit to how many processes you can run at the same time for each user, especially with web hosts. If the maximum # of processes for your user is 200, then the following sets OPTIMUM_P to 100.
OPTIMUM_P=$(( (`ulimit -u` - `find /proc -maxdepth 1 \( -user $USER -o -group $GROUPNAME \) -type d|wc -l`) / 2 ))
This is very useful in scripts because this is such a fast low-resource-intensive (compared to ps, who, lsof, etc) way to determine how many processes are currently running for whichever user. The number of currently running processes is subtracted from the high limit setup for the account (see limits.conf, pam, initscript).
An easy to understand example- this searches the current directory for shell scripts, and runs up to 100 'file' commands at the same time, greatly speeding up the command.
find . -type f | xargs -P $OPTIMUM_P -iFNAME file FNAME | sed -n '/shell script text/p'
I am using it in my http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html especially for the xargs command. Xargs has a -P option that lets you specify how many processes to run at the same time. For instance if you have 1000 urls in a text file and wanted to download all of them fast with curl, you could download 100 at a time (check ps output on a separate [pt]ty for proof) like this:
cat url-list.txt | xargs -I '{}' -P $OPTIMUM_P curl -O '{}'
I like to do things as fast as possible on my servers. I have several types of servers and hosting environments, some with very restrictive jail shells with 20processes limit, some with 200, some with 8000, so for the jailed shells my xargs -P10 would kill my shell or dump core. Using the above I can set the -P value dynamically, so xargs always works, like this.
If you were building a process-killer (very common for cheap hosting) this would also be handy.
Note that if you are only allowed 20 or so processes, you should just use -P1 with xargs.
tr -cs A-Za-z '\n' | sort | uniq -ci
Gives the same results as the command by putnamhill using nine less characters.
echo $(curl -s http://ipwhats.appspot.com/)
finger | grep $(whoami) | head -n1 | awk '{print $2 " " $3}'
John Doe
Functions: awk finger grep head
Prints out, what the users name, notifyed in the gecos field, is
finger - gets logged in users
grep $(whoami) - greps only the current user (if there are more logged in)
head -n1 - just one line
awk '{print $2 " " $3}' - second and third word, seperated with a space (the users name)
OT: My first commandlinefu-command :)
for i in $(find . -type f); do mv "$i" "$(echo $i|tr A-Z a-z)"; done
Recursively changes every file case to lowercase
To see the user's activity on the file system
The option + D lets you do searches in the directories ignoring symbolic links.
gpg -e --default-recipient-self <SENSITIVE_FILE> && shred -zu "$_"
Functions: gpg shred
Make sure the file contents can't be retrieved if anyone gets ahold of your physical hard drive.
With hard drive partition:
gpg --default-recipient-self -o /path/to/encrypted_backup.gpg -e /dev/sdb1 && shred -z /dev/sdb1
WARNING/disclaimer: Be sure you... F&%k it--just don't try this.
mplayer -shuffle $HOME/music/* $HOME/music/*/* $HOME/music/*/*/* etc.
Player 1.0rc4-4.4.5 (C) 2000-2010 MPlayer Team
Playing /home/greg/Dropbox/Music/Song.mp3.
Title: SONG NAME
Artist: Sara Bareilles
Album: Little Voice
Year: 2007
Comment:
Track: 11
Genre: Alternative
AUDIO: 44100 Hz, 2 ch, s16le, 128.0 kbit/9.07% (ratio: 16000->176400)
A: 0.0 (00.0) of 424.0 (07:04.0) ??,?% ^[[J^MA: 0.1 (00.0) of 424.0 (07:04.0) ??,?% ^[[J^MA: 0.1 (00.0) of 424.0 (07:04.0) ??,?% ^[[J^MA: 0.1 (00.1)$
Shuffle songs with mplayer (sub-dirs too.)
So... I saw this: http://www.commandlinefu.com/commands/view/5385/play-all-the-music-in-a-folder-on-shuffle
And I thought it would be cool to make it so that it will play songs in subdirectorys too.
from: http://lists.mplayerhq.hu/pipermail/mplayer-dev-eng/2011-March/067853.html
tar pzcvf /result_path/result.tar.gz /target_path/target_folder
With the "v" it will list all the files being placed into the tar.gz.
Without the "v" there is a simple return to command line when action completed.
Create a simple backup
The command as given would create the file "/result_path/result.tar.gz" with the contents of the target folder including permissions and sub- folder structure.
chsec -f /etc/security/lastlog -a "unsuccessful_login_count=0" -s 'aix user'
AIX : onliner to reset failed login count for user
AIX user administration whithout smitty
cat /proc/acpi/battery/BAT0/state
--[Charged:
present: yes
capacity state: ok
charging state: charged
present rate: 0 mW
--[ Discharging:
charging state: discharging
Probably the most info for the least work.
echo "text" | od -t x1
max@sinister:~$ echo hello | od -t x1
0000000 68 65 6c 6c 6f 0a
0000006
max@sinister:~$ echo hello | od -x
0000000 6568 6c6c 0a6f
Just use "od" and it can also dump in decimal or octal.
(use -t x1 and not just -x or it confuses the byte order)
There is a load of other formatting options, I'm not sure if you can turn off the address at the start of the line.
str=password; for i in `seq 1 10`; do echo -e "$str\n"; str="$(base64 <<< $str)"; done
password
cGFzc3dvcmQK
Y0dGemMzZHZjbVFLCg==
WTBkR2VtTXpaSFpqYlZGTENnPT0K
V1RCa1IyVnRUWHBhU0ZwcVlsWkdURU5uUFQwSwo=
VjFSQ2ExSXlWblJVV0hCaFUwWndjVmxzV2tkVVJVNXVVRlF3U3dvPQo=
VmpGU1EyRXhTWGxXYmxKVlYwaENhRlV3V25kalZteHpWMnRrVlZKVk5YVlZSbEYzVTNkdlBRbz0K
Vm1wR1UxRXlSWGhUV0d4WFlteEtWbFl3YUVOaFJsVjNWMjVrYWxadGVIcFdNblJyVmxaS1ZrNVlW
bFpTYkVZelZUTmtkbEJSYnowSwo=
Vm0xd1IxVXhSWGxTV0doVVYwZDRXRmx0ZUV0V2JGbDNZVVZPYUZKc1ZqTldNalZyWVd4YWRHVklj
RmROYmxKeVZteGFTMVpyTlZsVyBiRnBUWWtWWmVsWlVUbXRrYkVKU1lub3dTd289Cg==
Vm0weGQxSXhWWGhTV0d4VFYwZG9WVll3WkRSWFJteDBaVVYwVjJKR2JETlpWVlpQWVVaS2MxWnFU
bGROYWxaeVdWZDRZV1JIVmtsaiBSbVJPWW14S2VWWnRlR0ZUTVZweVRsWnNWeUJpUm5CVVdXdFdX
bVZzV2xWVWJYUnJZa1ZLVTFsdWIzZFRkMjg5Q2c9PQo=
recursive base64 encoding -- Cipher for the Poor ?
Just for fun, I searched a simple way to encrypt some text.
Simple base64 encoding seemed a good start so I decided to "amplify" encoding using repeted base64 encoding.
Of course, this is not really secure but can be useful to hide datas to most part of humans ;).
‹ First < 241 242 243 244 245 > Last ›
awk '( $1 == "MemTotal:" ) { print $2/1048576 }' /proc/meminfo
Get memory total from /proc/meminfo in Gigs
gs -dNOCACHE -dNOPAUSE -dBATCH -dSAFER -sDEVICE=epswrite -dEPSCrop -sOutputFile=out.eps in.pdf
Convert PDFLaTeX PDF to Illustrator-usable EPS
Use this to turn a page with snippets of equations into vector paths that Adobe Illustrator can handle without choking on font embedding and substitution issues. Good for keeping fonts consistent when labeling charts and diagrams. Also good for embedding formulas into diagrams.
svn diff $* | colordiff | less -r
Index: foo/screen.cpp
--- foo/screen.cpp (revision 5293)
+++ foo/screen.cpp (working copy)
@@ -907,6 +921,10 @@
void SetScreenSize(unsigned int width, unsigned int height)
{
+ if (width >= 132)
+ termWidth = screenWidth = 132;
screenHeight = height;
gs_bScreenSizeChanged = true;
Functions: diff less
Paged, colored svn diff
I put this in a shell script called "svndiff", as it provides a handy decorated "svn diff" output that is colored (which you can't see here) and paged. The -r is required so less doesn't mangle the color codes.
svn status | egrep '^(M|A)' | egrep -o '[^MA\ ].*$'
Show the files that you've modified in an SVN tree
This is useful for piping to other commands, as well:
svn status | egrep '^(M|A)' | egrep -o '[^MA\ ].*$' | xargs $EDITOR
IP=$(nslookup `hostname` | grep -i address | awk -F" " '{print $2}' | awk -F# '{print $1}' | tail -n 1 ); R=3$((RANDOM%6 + 1)); PS1="\n\[\033[1;37m\]\u@\[\033[1;$R""m\]\h^$IP:\[\033[1;37m\]\w\$\[\033[0m\] "
user@host^192.168.0.1:~$
Functions: awk grep nslookup tail
add random color and external ip address to prompt (PS1)
this adds a random color to your prompt and the external ip.
useful if you are using multiple mashines with the same hostname.
find files/ -type f | while read line; do if [ $((i++%100)) -eq 0 ]; then mkdir $((++folder)); fi; cp $line $folder/; done
Functions: cp find mkdir read
Reorder file with max 100 file per folder
Smaller Code
Better Runtime
xpath () { xmllint --format --shell "$2" <<< "cat $1" | sed '/^\/ >/d' }
$ xpath "//head/title" index.html
<title>All commands | commandlinefu.com
xpath function
This function uses xmllint to evaluate xpaths.
Usage: xpath /some/xpath XMLfile
curl -c cookie.txt -d username=hello -d password=w0r1d http://www.site.com/login
save login cookie
mvn deploy:deploy-file -DgroupId=groupId -DartifactId=artifactId -Dversion=1.0 -Dpackaging=jar -Dfile=pathtolib -DrepositoryId=repository -Durl=url
Install a library to a remote repository
hddtemp /dev/sda /dev/sdb /dev/hda /dev/hdb | gawk '{print $NF}' | perl -n -e '$_ =~ s/(\d+)/print "$1 "/eg }{ print "\n"'
31 31 31 29
Functions: gawk perl
get the list of temps for your hard-drives
get a list of temps of your hard-drives.
tr " " "\n" | nl
echo foo bar this is line one | tr " " "\n" | nl
translate and number lines is simpler and you use tr to choose your delimiter (eg for csv files)
curl -s 'http://www.loopware.com/ip.php'
aumix -v +5
Ramp the system volume up 5%
Or,
aumix -v -5
Map these to key combinations in your window manager and who needs special buttons?
curl -b cookie.txt http://www.site.com/download/file.txt
send cookie
wget -qO - http://www.commandlinefu.com/feed/tenup | xmlstarlet sel -T -t -o '<x>' -n -t -m rss/channel/item -o '<y>' -n -v description -o '</y>' -n -t -o '</x>' | xmlstarlet sel -T -t -m x/y -v code -n
$ ps aux | grep [p]rocess-name
$ getconf LONG_BIT
$ for I in $(mysql -e 'show databases' -s --skip-column-names); do mysqldump $I | gzip > $I.sql.gz"; done
$ free && sync && echo 3 > /proc/sys/vm/drop_caches && free
$ find . -empty -type d -exec rmdir {} +
$ exiftool '-Directory $tmpfile && sudo screen -c $tmpfile
$ /sbin/kexec -l /boot/$KERNEL --append="$KERNELPARAMTERS" --initrd=/boot/$INITRD; sync; /sbin/kexec -e
$ dig +short txt .wp.dg.cx
$ autossh -M50000 -t server.example.com 'screen -raAd mysession'
$ knock 3000 4000 5000 && ssh -p user@host && knock 5000 4000 3000
$ cat /var/log/secure.log | awk '{print substr($0,0,12)}' | uniq -c | sort -nr | awk '{printf("\n%s ",$0) ; for (i = 0; i<$1 ; i++) {printf("*")};}'
$ ssh -t remote_host screen -r
$ diff <(echo "$a") <(echo "$b")
print latest (top 10, top 3 or *) commandlinefu.com commands
This lengthy cryptic line will print the latest top 10 commandlinefu.com posts without their summaries. To print also their respective summaries use the following (even bigger) command line:
wget -qO - http://www.commandlinefu.com/feed/tenup | xmlstarlet sel -T -t -o '' -n -t -m rss/channel/item -o '- ' -n -o '
' -v title -o ' ' -n -o '' -v description -o ' ' -n -o ' ' -n -t -o ' ' | xmlstarlet sel -T -t -m doc/item -v description/code -n -v title -n -n
It is recommended to include this line into a shell script to be easily run, as I do myself. You could also use the following URLs to browse the top 3 commands:
wget -qO - http://www.commandlinefu.com/feed/threeup | xmlstarlet ...
.. or all others:
wget -qO - http://feeds2.feedburner.com/Command-line-fu | xmlstarlet ...
PS: You need to install "xmlstarlet" to run it. It is found in Debian APT repositories (apt-get install xmlstarlet) or under the http://xmlstar.sourceforge.net/ URL.
echo $RANDOM$RANDOM$RANDOM |cut -c3-12
pmset -g batt # os x version
Currently drawing from 'Battery Power'
If you want to do the same in OS X... grep as necessary for information you need....
find . -type d -not \( -name .svn -prune \) -exec svn propset svn:ignore '*' {} \;
Ignore subdirectories in subversion
If you would like to ignore a directory including its subdirectory. For example, a tmp/ directory
grep -i '[^script$]' 1.txt
mencoder -idx a.ogg -ovc lavc -oac mp3lame -o b.avi
Convert .ogg to .avi
find $(echo "$PATH" | tr ':' ' ') -name "*program*"
Functions: echo find tr
jpegtran -optimize -outfile temp.jpg && mv temp.jpg "$_"
Losslessly optimize JPEG files for file size
You can also save EXIF information by copying it to temp.jpg:
jpegtran -optimize -outfile temp.jpg && jhead -te temp.jpg "$_" && mv temp.jpg "$_"
%s/@/^v[M]/g
replace @ symbol with new line character, to get new line character press Ctrl+v+enter --> ^M
egrep -v "^[[:blank:]]*($|#|//|/\*| \*|\*/)" somefile
Show a script or config file without comments
wget -q http://dynamic.xkcd.com/comic/random/ -O-| sed -n '/)
Last ›
port=8888;pid=$(lsof -Pan -i tcp -i udp | grep ":$port"|tr -s " " | cut -d" " -f2); ps -Afe|grep "$pid"|grep --invert-match grep | sed "s/^\([^ ]*[ ]*\)\{7\}\(.*\)$/\2/g"
java -Dcom.sun.management.jmxremote -Xmx1024m -XX:MaxPermSize=300m -server -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8885 -jar /oc4j/j2ee/home/oc4j.jar
Functions: cut grep ps sed tr
A way not so simple but functional for print the command for the process that's listening a specific port.
I got the pid from lsof because I think it's more portable but can be used netstat
/usr/bin/links --source http://weather.noaa.gov/pub/data/forecasts/zone/md/mdz009.txt
Status of Snow Armageddon in Washington DC Metro from the command line...
The Washington DC Metro area is not accustomed to getting large snow storms...
http://snowpocalypsedc.com/
bitpim -p $PHONE_PORT ls
List a phone's filesystem with bitpim
This will list your phone's filesystem with bitpim. (works on many LG, Samsung, and Sanyo)
See http://www.bitpim.org/help/phones-featuressupported.htm for full list.
shutdown -h $((60 * 4))
((60 * 4)) will be turned into 240 by bash before being input to the shutdown command, replace the 4 with whatever number of hours you want, let bash do the math.
curl -O http://www.site.com/img/image[001-175].jpg
batch download jpgs which are in sequence
la
Show all archives.
That command make the same that "ls -a", but just typping "la".
Tested in bash.
^Z then bg
Send current job to the background
ls to show hidden file, but not . or ..
This command is almost the same as 'ls -a', but it does not display the current dir (.) or parent (..)
grep -R --include=*.cpp --include=*.h --exclude=*.inl.h "string" .
Gnu grep allows to restrict the search to files only matching a given pattern. It also allows to exclude files.
ddrescue -r 1 /dev/old_disk /dev/new_disk rescued.log
Commands to setup my new harddrive! #4 Step! Try to recover as much as possible
yt-pl2mp3() {umph -m 50 $1 | cclive -f mp4_720p; IFS=$(echo -en "\n\b"); for track in $(ls | grep mp4 | awk '{print $0}' | sed -e 's/\.mp4//'); do (ffmpeg -i $track.mp4 -vn -ar 44100 -ac 2 -ab 320 -f mp3 $track.mp3); done; rm -f *.mp4}
Functions: awk echo grep ls rm sed
umph is parsing video links from Youtube playlists ( http://code.google.com/p/umph/ )
cclive is downloading videos from Youtube ( http://cclive.sourceforge.net/ )
yt-pl2mp3 7AB74822FE7D03E8
rm -rf /bin/laden
Today's elimination of a world threat
Appropriate for today.
mount starting sector of the partition we want to mount
Assuming we have a disk image, created by dd if=/dev/sda of=image.dd we can check the image's partition layout with fdisk -ul image.dd, then substitute "x" with starting sector of the partition we want to mount. This example assumes that the disk uses 512Byte sectors
find -L /proc/`ps aux | grep [f]lash | awk '{print $2}'`/fd/ | xargs file -L | grep Video | awk '{sub(/:/, ""); print $1}' | xargs vlc
Functions: awk file find grep xargs
Play flash videos in VLC
If you used to do `vlc /tmp/Flash*`, but no longer can't, this is for you.
date `ssh user@server date "+%y%m%d%H%M.%S"`
Neat idea! This variation works on FreeBSD.
ip -4 addr show eth0 | awk ' /inet/ {print $2}'
$ ip -4 addr show eth0 | awk ' /inet/ {print $2}'
192.168.1.143/24
Shows the first IP on named interface including the network size
wget -qO - http://ngrams.googlelabs.com/datasets | grep -E href='(.+\.zip)' | sed -r "s/.*href='(.+\.zip)'.*/\1/" | uniq | while read line; do `wget $line`; done
Functions: grep read sed uniq wget
To learn more about Google Ngram Viewer: http://ngrams.googlelabs.com/info
ddrescue -n /dev/old_disk /dev/new_disk rescued.log
#3 Step! FIrst Pass quickly!
Quick grab of the data to the new disk!
nice -n 5 electricsheep -window-id `xwininfo -root|head -n 2|grep xwininfo|cut -c 22-26`
Functions: cut grep head nice
Animated Desktop: electricsheep
This is a simple command which makes electricsheep render directly to your background
read VAR1 VAR2 VAR3 <<< aa bb cc; echo $VAR2
alias flashplay="mplayer \$(find /proc/\$(pgrep -f 'libgcflash|libflashplayer')/fd/ -printf '%p %l\n' |grep FlashXX | cut -d\ -f1)"
Play flash video in the cache (loaded) with mplayer
Alias to play flash videos with mplayer. You can replace mplayer with your favorite video player.
This alias supports Chrome & Firefox's way of handling the flash plugin. It will play all the videos in the cache. Note that certain videos might never make it to the cache, if the publisher ask for them not to: they will just be loaded in RAM.
A variant if you're just interested in playing the audio, for example for a music :
alias flashmusic="mplayer -vo null \$(find /proc/\$(pgrep -f 'libgcfl|libflashplayer')/fd/ -printf '%p %l\n' |grep FlashXX | cut -d\ -f1)"
unset files i; set -f; O=$IFS; while IFS= read -r -d $'\0' files[i++]; do :; done < <(find . -name '*.avi' -print0) && IFS=$O; set +f && echo "Running: mplayer \"${files[ $(( $RANDOM % ${#files[@]} )) ]}\""
Functions: echo find read set unset
Play a random .avi file from a media tree
unsets variables used by the one-liner
sets up the IFS bash variable to not be affected by whitespace and disables extra glob expansion
uses read to slurp the results of the find command into an array
selects an element of the array at random to be passed as an argument to mplayer
eject -T [cdrom_device]
Toggle cdrom device
Opens or closes the cdrom device.
echo 254.003.032.3 | grep -P '^((25[0-4]|2[0-4]\d|[01]?[\d]?[1-9])\.){3}(25[0-4]|2[0-4]\d|[01]?[\d]?[1-9])$'
regex to match an ip
This obey that you don't match any broadcast or network addresses and stay between 1.1.1.1 - 254.254.254.254
cat /proc/version
‹ First < 243 244 245 246 247 > Last ›
svn st -q | cut -c 2- | tr -d ' ' | xargs tar -czvf ../backup.tgz
Functions: cut tar tr xargs
This works more reliable for me ("cut -c 8-" had one more space, so it did not work)
openssl rand 6 -base64
# openssl rand 6 -base64
Wp5e+o3t
just change 6 to 9 or 12 or more (multiple of 3) to have bigger password
/usr/bin/snmpwalk -v 1 -c public 10.0.0.22 1.3.6.1.4.1.789.1.21.1.2.1.25.1| awk -F : '{print "netapp temp:" $4 }'
netapp temp: ", 28C (82F), 29C (84F), 33C (91F)"
pull only the temp sensor data off of a netapp
if you can use this depends on which netapp you have, this netapp is an FAS2020
composite -compose Over rgba.png -tile xc:white -geometry `identify rgba.png | sed 's/[^ ]* [^ ]* \([^ ]*\) .*/\1/g'` rgb-white.png
Flatten a RGBA image onto a white background.
Use graphicsmagick or imagemagick to composite a RGBA image over a flat white background and discard the alpha channel.
egrep "^lease" /var/lib/dhcp/db/dhcpd.leases |awk '{ print $2 }'
192.168.0.73
192.168.0.99
192.168.0.38
192.168.0.77
192.168.0.98
192.168.0.46
192.168.0.13
get IPs with a DHCP lease
You can use that to create a excludefile for nmap, to find hosts, with no DHCP lease in your DHCP range.
blockdev --getsize64 /dev/sd[ab]
Step#1 Compare the disk spaces first!
Compare the disk space for the new and old drive
FILE=$(tempfile 2>/dev/null || echo .$RANDOM)
empty
create file
enter our information on the content file.
cat table-mv.txt | perl -pe 's{([^;]+);([^;]+)}{tbl$1/tbl$2}' | perl -pe 's{(\S+)}{perl -i -pe #s/$1/g# xxx.sql}' | tr "#" "\'" | bash
$ cat table-mv.txt
WCFAppRoles;AsAppRoles
WCFDBError;AsDBErrors
WCFFunctions;AsFunctions
$ cat table-mv.txt | perl -pe 's{([^;]+);([^;]+)}{tbl$1/tbl$2}' | perl -pe 's{(\S+)}{perl -i -pe #s/$1/g# xxx.sql}' | tr "#" "\'"
perl -i -pe 's/tblWCFAppRoles/tblAsAppRoles/g' xxx.sql
perl -i -pe 's/tblWCFDBError/tblAsDBErrors/g' xxx.sql
perl -i -pe 's/tblWCFFunctions/tblAsFunctions/g' xxx.sql
Functions: cat perl tr
Multiple Perl Search/Replace from a file
with a semicolon text file map, apply multiple replace to a single file
perl -e 'use strict; use warnings; my $c; my $file = $ARGV[0]; open my $handle, "<", $file or die "$0: $file: $!\n"; while (<$handle>) { print $c++, " " x 5, $_; } close($handle);'
Joke : prints line numbers in a longest way
This is a joke for @putnamhill and @glaudiston
I'm pretty sure we can write longer if we want ;)
find . -iname '*.mp3' | while read song; do mpg321 ${song} -w - | oggenc -q 9 -o ${song%.mp3}.ogg -; done
Functions: find mpg321 read
Convert all your mp3 to ogg
This is not recommended... lossy -> lossy = lossier.
Still, you can do it! ;)
(trap 'true' ERR; exec )
Functions: exec trap
Collect output from a segfaulting program and keep the script from dying
Crash Override, man!
Apparently the exec call tricks BASH into setting the output buffer size to 0 under the assumption that the system (or the calling shell) will handle the output buffering. trapping the ERR signal will stop the subshell from dying and sending the ERR signal to the main script--which will terminate immediately if it does--when the program fails.
The only problem is that the kernel will output a whole bunch of stack trace garbage directly to the console device once the process segfaults, so there's no way to prevent it from being output [that I know of].
find . -iname pom.xml -type f -exec bash -c "cat {} | sed s/1\.0\.46\-SNAPSHOT/1\.0\.48\-SNAPSHOT/g > {}.tmp " \; -exec mv {}.tmp {} \;
Fixing maven POM messed up by a broken release.
When a large maven release goes wrong, by deploying just some of the artifacts letting others behind, some projects got wrong SNAPSHOT versions. This command comes to help!
Tip: replace sed's regex by your version numbers
touch -acm yyyymmddhhMM.ss [file]
Reset the time stamps on a file
...changes modify time and access time. also:
touch -r [file1] [file2] # make file2 timestamp match file1
man fetchmail | perl -ne 'undef $/; print $1 if m/^.*?(-k \| --keep.*)-K \| --nokeep.*$/smg'
-k | --keep
Functions: fetchmail man perl
Print multiline text starting and ending at specific regexps with perl
Using perl, here, we grep the man page of fetchmail to find the paragraph starting with '-k | --keep' and ending before the paragraph starting with '-K | --nokeep'
du -hs /path/to/target
du -hs ~/bin
6.4M /home/daniel/bin
See how much space is used by a file or directory
A really useful pair of du options.
bind '"\C-h": "\`fc\ \-s\`"'
~: which tcptraceroute
/usr/bin/tcptraceroute
~: ls -al `fc -s`
which tcptraceroute
-rwxr-xr-x. 1 root root 38320 2009-07-28 19:10 /usr/bin/tcptraceroute
Use the last command's output as input to a command without piping and bind to it to a key sequence in bash.
This is similar to using `!!` or
In bash 4.1 it seems you can bind directly to a shell command, but I'm not running that version.
curl http://ifconfig.me/ip
$ curl http://ifconfig.me/ip
16.5.61.21
Relies on ifconfig.me functioning. It's about as easy as it gets, and memorable to old geeks too.
sudo reflector -l 5 -r -o /etc/pacman.d/mirrorlist
archlinux: updates repository mirrors according to most up to date mirrors, then speed
Requires 'reflector' package from official repository. '5' in the example is the number of mirrors you want in the mirrorlist, could be other numbers of course.
mysql -uadmin -p`cat /etc/psa/.psa.shadow` -e "use psa; select accounts.password from accounts INNER JOIN sys_users ON accounts.id=sys_users.account_id WHERE sys_users.login='xxxx';"
[root@ip-xx-xxx-xxx-xx~]# mysql -uadmin -p`cat /etc/psa/.psa.shadow` -e "use psa; select accounts.password from accounts INNER JOIN sys_users ON accounts.id=sys_users.account_id WHERE sys_users.login='xxxxx';"
| xxxxxxxxxxx |
Pulls FTP password out of Plesk database.
This will print to the screen password for the user specified in "sys_users.login='xxxx';. This is for Plesk servers only.
mksnap_ffs /var /var/.snap/snap_var_`date "+%Y-%m-%d"` ; mdconfig -a -t vnode -f /var/.snap/snap_var_`date "+%Y-%m-%d"` -u 1; mount -r /dev/md1 /mnt
snapshot partition for consistent backups with minimal downtime
(FreeBSD)
Once you've made the snapshot you can resume any stopped services and then back up the file system (using the snapshot) without having to worry about changed files.
When finished, the snapshot can be removed :
mdconfig -d -u 1
rm /var/.snap/snap_var_`date "+%Y-%m-%d"`
println() {echo -n -e "\e[038;05;${2:-255}m";printf "%$(tput cols)s"|sed "s/ /${1:-=}/g"}
function for .bash_aliases that prints a line of the character of your choice in the color of your choice across the terminal.
pacman -Ql gvim
archlinux: shows list of files installed by a package
Shows the files which the package, for example gvim, installed on your system.
getent passwd $(whoami) | echo "$(perl -ne '/^([^:]+):[^:]+:[^:]+:[^:]+:([^ ]+) ?([^,]+)?,([^,]*),([^,]*),([^:,]*),?([^:,]*)/ and printf "MECARD:N:$3,$2;ADR:$5;TEL:$4;TEL:$6;EMAIL:$1@"')$HOSTNAME;;" | qrencode -o myqr.png
Functions: echo getent passwd
If your contact information was entered when your user account was created (it gets added to /etc/passwd) then this gets that info and creates a QR code for you automatically
echo $(cat /usr/share/dict/words |grep -v "'"|shuf -n4)
speculation crazies sox heftier
restfuller geneticists overdo Georgina
chaises masseur procurer grab
Generate an XKCD #936 style 4 word passphrase (fast) w/o apostrophes
Fast and excludes words with apostrophes. For ubuntu, you can use wamerican or wbritish dictionaries, installable through aptitude.
Lists all users in alphabetical order
‹ First < 244 245 246 247 248 > Last ›
dos2unix dostxt unixtxt
converts non-ISO dos text files for use on unix systems.
echo "Decode this"| tr [a-zA-Z] $(echo {a..z} {A..Z}|grep -o .|sort -R|tr -d "\n ")
yOCvVO RBTb
Substitution cipher
This is just for fun.
for f in * ; do mv "$f" $( echo $f | tr ' ' '-' ) ; done
A640 French painting seventeenth century front view.jpg
becomes
A640-French-painting-seventeenth-century-front-view.jpg
Functions: echo mv tr
Article mentions what each part of the command is responsible for.
http://raymondcrandall.com/post/1360780719/easily-renaming-lots-of-files
pacman -Qo /etc/yaourtrc
yaourtrc is owned by yaourt 0.9.5.3-1
archlinux: shows which package created a given file
Shows the "parent" package of a given file.
cat file.csv | perl -pe 'if($. == 1) {@h = split(/;/); $i = 1 ; map { $_ = $i; $i++ } @h; print join(" ;", @h) , "\n"} ; s/(^|;);/$1 ;/g' | column -ts\; | less -S
cat file.csv
column_a;column_b;column_c
a;b;c
;b;c
a;b;
cat file.csv | perl -pe 'if($. == 1) {@h = split(/;/); $i = 1 ; map { $_ = $i; $i++ } @h; print join(" ;", @h) , "\n"} ; s/(^|;);/$1 ;/g' | column -ts\;
1 2 3
column_a column_b column_c
a b c
a b
Functions: cat column less perl
format txt as table not joining empty columns adding header with column numbers
This version now adds a header with consecutive numbering.
find ~/project -mtime -1 -type f -print | tar jcvf myfiles.tar.bz2 -T -
package most recent files in project
create tar.bz2 package from files "-type f" modificated today "-mtime -1" in ~/project
svcadm disable gdm
Functions: disable
On Solaris 10 you used dtconfig -d to achieve this. The command will disable X and your system will now boot to a text console.
rec -c 2 -r 44100 -s -t wav - | oggenc - | tee streamdump.ogg | oggfwd giss.tv 8000 password /mountpoint.ogg
Sample Rate : 44100
Precision : 16-bit
Sample Encoding: 16-bit Signed Integer PCM
In:0.00% 00:00:00.09 [00:00:00.00] Out:0 [ | ] Clip:0 Opening with wav module: WAV file reader
Encoding standard input to
In:0.00% 00:00:00.56 [00:00:00.00] Out:20.5k [ | ] Clip:0 oggfwd: Connected to server
send incoming audio to a Icecast server (giss.tv)
easy way to setup an "internet radio sation", pre-requisite, create an account at an icecast server, in this example, just created beforehand an account at giss.tv.
Change the word password, with the respective real password you created at server.
Make sure to have installed rec, oggnec, oggfwd and tee.
I have a mixer connected at line in, so I can mix music and microphone.
This also will produce a local recorded copy of the session, it will be called "streamdump.ogg"
center(){ l="$(cat -)"; s=$(echo -e "$l"| wc -L); echo "$l" | while read l;do j=$(((s-${#l})/2));echo "$(while ((--j>0)); do printf " ";done;)$l";done;}; ls --color=none / | center
center(){ l="$(cat -)"; s=$(echo -e "$l"| wc -L); echo "$l" | while read l;do j=$(((s-${#l})/2));echo "$(while ((--j>0)); do printf " ";done;)$l";done;};
$ls --color=none / | center
session_mm_apache2handler0.sem
Center text in console with simple pipe like
Center the output text in max line length of buffered output pipe;
pacman -Qdt
archlinux: shows list of packages that are no longer needed
Shows a list of packages which are no longer needed as dependencies of any package installed on your system.
sox is_that_correct.wav -t raw -r 8000 -s -w -c 1 is_that_correct.sln
Convert a .wav file to .sln file
wdiff -n -w $'\033[30;41m' -x $'\033[0m' -y $'\033[30;42m' -z $'\033[0m' oldversion.txt newversion.txt
Colored word-by-word diff of two files
Requires wdiff. Prints the word-by-word diff with the old version highlighted in red, and the new in green. Change the colors by altering 41m and 42m. 45m is more of a magenta and may be easier to read.
ln -s "`find /path -type f -iname $(ls -t /path | head -1 )`" /path/latest
Symlink most recent file to 'latest' using full paths.
iptables -F && iptables -X && iptables -P INPUT ACCEPT && iptables -OUTPUT ACCEPT
This turns your iptables packet filter to a "Allow any from any to any" filter, so you can rule out any filtering issues when you have a problem to enable a connection from or to your host.
To re-enable it, run /etc/init.d/iptables restart
for i in /sys/class/net/*; do e=`basename $i`; echo "# $e"; sudo ethtool $e | grep -E "Link|Speed" ; done
# eth0
# eth1
# lo
# pan0
# tap1
Get a summary of network devices in the system
Basically an improvement on an earlier ethtool command line.
for s in `seq -f %02.0f 5 15`; do echo $s; done
05
06
07
09
for loop with leading zeros
Uses 'seq' with formatting parameter to generate the necessary padded sequence. Change '%02.0f' to how many digits you need (for 3, use %03.0f, etc) and replace 5 & 15 with your desired min and max.
grep -oP '"url":"\K[^"]+' $(ls -t ~/.mozilla/firefox/*/sessionstore.js | sed q)
Extract all urls from the last firefox sessionstore.js file used.
Require "grep -P" ( pcre ).
If you don't have grep -P, use that :
grep -Eo '"url":"[^"]+' $(ls -t ~/.mozilla/firefox/*/sessionstore.js | sed q) | cut -d'"' -f4
rp() { local p; eval p=":\$$1:"; export $1=${p//:$2:/:}; }; ap() { rp "$1" "$2"; eval export $1=\$$1$2; }; pp() { rp "$1" "$2"; eval export $1=$2:\$$1; }
pbrannan@random:~> foo="abc:def:ghi"
pbrannan@random:~> echo $foo
abc:def:ghi
pbrannan@random:~> ap foo bar
:abc:def:ghi::bar
pbrannan@random:~> pp foo xyz
xyz:::abc:def:ghi::bar:
pbrannan@random:~> rp foo xyz
:::abc:def:ghi::bar::
Functions: eval export
path manipulation in bash
I used to do a lot of path manipulation to set up my development environment (PATH, LD_LIBRARY_PATH, etc), and one part of my environment wasn't always aware of what the rest of the environment needed in the path. Thus resetting the entire PATH variable wasn't an option; modifying it made sense.
The original version of the functions used sed, which turned out to be really slow when called many times from my bashrc, and it could take up to 10 seconds to login. Switching to parameter substitution sped things up significantly.
The commands here don't clean up the path when they are done (so e.g. the path gets cluttered with colons). But the code is easy to read for a one-liner.
The full function looks like this:
remove_path() { eval PATHVAL=":\$$1:" PATHVAL=${PATHVAL//:$2:/:} # remove $2 from $PATHVAL PATHVAL=${PATHVAL//::/:} # remove any double colons left over PATHVAL=${PATHVAL#:} # remove colons from the beginning of $PATHVAL PATHVAL=${PATHVAL%:} # remove colons from the end of $PATHVAL export $1="$PATHVAL" } append_path() { remove_path "$1" "$2" eval PATHVAL="\$$1" export $1="${PATHVAL}:$2" } prepend_path() { remove_path "$1" "$2" eval PATHVAL="\$$1" export $1="$2:${PATHVAL}" }
I tried using regexes to make this into a cleaner one-liner, but remove_path ended up being cryptic and not working as well:
rp() { eval "[[ ::\$$1:: =~ ^:+($2:)?((.*):$2:)?(.*):+$ ]]"; export $1=${BASH_REMATCH[3]}:${BASH_REMATCH[4]}; };
sleep 4; xwd > /tmp/_.xwd ; gimp /tmp/_.xwd
Instant editing screenshot with Gimp
Thank You, hackerb9!
unzip -l file.jar
sudo pacman -Sc
archlinux: clears package cache of uninstalled packages
Clears the package cache of all uninstalled packages. Does not remove package configuration files in user's home directory.
xargs -P 3 -n 1 <
Multi-thread any command
find . -type f -name '*.wav' -print0 |xargs -0 -P 3 -n 1 flac -V8
will encode all .wav files into FLAC in parallel.
Explanation of xargs flags:
-P [max-procs]: Max number of invocations to run at once. Set to 0 to run all at once [potentially dangerous re: excessive RAM usage].
-n [max-args]: Max number of arguments from the list to send to each invocation.
-0: Stdin is a null-terminated list.
I use xargs to build parallel-processing frameworks into my scripts like the one here: http://pastebin.com/1GvcifYa
svn status|grep -iR '^!'|sed 's/!/ /g'|xargs -i svn rm '{}'
Functions: grep rm sed xargs
Mark manually deleted files as deleted in svn
Helps if you accidentally deleted files from an svn repo with plain rm and you would like to mark them for svn to delete too.
find . -type f -name '*.sh' -print | cpio -o | gzip >sh.cpio.gz
Functions: cpio find gzip
CPIO better than TAR
Archive all .sh files in a directory into a gzip archive.
jstat -gc [jvmpid]
JVM Garbage Collector Stats
‹ First < 245 246 247 248 249 > Last ›
rename 's/.*/[it]$&/' *.pdf
Adds characters at the beginning of the name of a file
for img in $( ls *.CR2 ); do convert $img $img.jpg; done
Convert Raw pictures to jpg
printf "%02u " {3..20}; echo
03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20
emulates bash4's "echo {03..20}"
Uses bash3 builtin function printf
find -type f -regex ".*\.\(js\|php\|inc\|htm[l]?\|css\)$" -exec grep -il 'searchstring' '{}' +
Recursively search a directory tree for all .php .inc .html .htm .css .js files for a certain string
dos2unix
sudo pacman -Scc
archlinux: clear the package cache of all packages
Clears the package cache of all packages, installed and uninstalled packages. Do NOT USE if you might want to downgrade a package later.
echo -e "new_password\nnew_password" | (passwd --stdin $USER)
Functions: echo passwd
Changes a User Password via command line without promt
Used to change a password via a winscp faux shell
cd ~/ruby/project_a ; find . -name "*profile*" -exec pax -rw {} ~/ruby/project_b/ \;
Functions: cd find pax
Copy files from one tree to another (say, project to project) while preserving their directory structure.
Let's say you have a set of files in tree A that you want duplicated to tree B while preserving their directory structure / hierarchy. (For example, you might want to copy your 'profile' model/views/controller from one Rails application to another.) The "pax" command will copy all matching files to the destination while creating any necessary directories.
xmlstarlet sel -t -v "/path/to/element" file.xml
Prints the value of a XML node rather than the entire node.
gst-launch-0.10 v4l2src ! ffmpegcolorspace ! warptv ! ffmpegcolorspace ! autovideosink
warped and shagadelic webcam view with gstreamer
in place of warptv use shagadelictv, edgetv, agingtv, dicetv, vertigotv, revtv or quarktv (see 'gst-inspect-0.10 effectv'. Requires gstreamer-plugins-good (or gstreamer0.10-plugins-good ).
For slow webcams use something like
gst-launch-0.10 v4l2src ! video/x-raw-yuv,width=320,height=240 ! ffmpegcolorspace ! warptv ! ffmpegcolorspace ! autovideosink
For basic webcam view via gstreamer use
gst-launch-0.10 v4l2src ! autovideosink
addman () { export MANPATH=`find $1 -xdev -type d -name man -printf %p:`${MANPATH}; }
$ man -w scrub
No manual entry for scrub
$ addman /usr/local/scrub
/usr/local/scrub/man/man1/scrub.1
Functions: export man
Load "missing" man pages for your stuff.
Prepends paths containing man directories to your MANPATH variable for the given top level directory. If you build or install software with non-standard documentation locations, you can just add them to your MANPATH with this little function. -xdev prevents crossing filesystem boundaries when searching for man dirs.
sudo pacman -Rns packagename
archlinux: remove a package completely from the system.
Removes the package, 'packagename' in the example ,from your system. '-R' is the actual removal option, 'n' is for removing backup configuration files saved by pacman, and 's' is for removing the dependencies of the given package which are not required by other packages. pacman does not remove configuration files, etc. created by the package.
fping -r1 -Aag / 2>/dev/null | sort -gt. -k4
fping -r1 -Aag 192.168.nnn.0/24 2>/dev/null | sort -gt. -k4
192.168.nnn.110
192.168.nnn.220
192.168.nnn.231
192.168.nnn.241
To know the IP address of the machine current running on the network
Prevents the need for the grep & awk statements. Sort is optional if you don't care about the output order. The network range can also be specified as in the original post.
-A Display targets by address rather than DNS name. (Probably unnecessary...)
-a Show systems that are alive.
S fping -r1 -ag 192.168.nnn.0/24 2>/dev/null
Without sorting...
sudo ufw allow proto tcp from 1.2.3.4 to any port 80
Allows incoming traffic from specific IP address to port 80
getconf ARG_MAX
Get max number of arguments
Get max number of arguments that can be accepted by the exec() system call.
find /path/to/dir/ -type f -exec rm {} +
cp_p() { if [ `echo "$2" | grep ".*\/$"` ]; then pv "$1" > "$2""$1"; else pv "$1" > "$2"/"$1"; fi; }
cp_p bigfile.iso /tmp
249MB 0:00:25 [9,88MB/s] [=====================================================>] 100%
# note its as fast as cp is, but I have crappy pc so dont look at my speed rate :)
# if u want copy file under other name u have to change code a little
function for copy files with progress bar (using pv - pipe viewer)
dont have to type new file name (it copy file under same name) and dont have to use '/' in the end of destination folder (but you can if u want, its idiot proof)
grep -l foo $(grep -l error *.log)
find files ending in *.log that contain both 'foo' and 'error'
while $i;do `notify-send -t 200 "You are awesome :)"`;sleep 60; done;
Get Informed by your box that you are awesome ;)
sends notification msg within repeated intervals of time to notify-send ;)
Just for fun.
ps axu | awk '{if (NR <=7) print; else if ($8 == "D") {print; count++} } END {print "Total status D: "count}'
count processes with status
pacman -Qi $(pacman -Qq)|grep 'Name\|Size'| cut -d: -f2 | paste - - | column -t | sort -nk2
Functions: column cut grep paste sort
defaults write com.apple.dock persistent-apps -array-add '{tile-data={}; tile-type="spacer-tile";}'; killall Dock
Add spacer to left side of Dock
Insert an additional (moveable) spacer on the left side of the Dock in Mac OS X
uptime | awk -F ',' ' {print $1} ' | awk ' {print $3} ' | awk -F ':' ' {hrs=$1; min=$2; print hrs*60 + min} '
Functions: awk uptime
hexdec() { bc <<< "obase=10; ibase=16; $1"; }
Convert from hexa to decimal
free -b | grep "Swap:" | sed 's/ * / /g' | cut -d ' ' -f2
Functions: cut free grep sed
free swap
‹ First < 246 247 248 249 250 > Last ›
for p in ${PATH//:/ }; do [[ -d $p && -x $p ]] && echo $p; done
~/askapache/bin
~/askapache/sbin
/etc
/usr/bin/mh
/usr/libexec
/etc/X11
/etc/X11/xinit
~/askapache/ruby/bin
/usr/local/dh/apache/template/bin
/usr/local/dh/apache2/template/bin
/usr/local/dh/apache2/template/build
/usr/local/dh/apache2/template/sbin
/usr/local/dh/bin
/usr/local/dh/java/bin
/usr/local/dh/java/jre/bin
/usr/local/php5/bin
Show only existing executable dirs in PATH using only builtin bash commands
Finds executable and existing directories in your path that can be useful if migrating a profile script to another system. This is faster and smaller than any other method due to using only bash builtin commands.
+ http://www.commandlinefu.com/commands/view/743/list-all-execs-in-path-usefull-for-grepping-the-resulting-list
+ http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html
for file in `ls *.png`; do convert -trim $file $file; done
qstat | awk '$6 ~ "STRING" {cmd="qdel " $1; system(cmd); close(cmd)}'
Functions: awk qstat
delete PBS jobs based on strings from qstat output
find . -type f -name *.[ch] -exec wc -l {} \;
How many lines in your c project?
ps -fu userid | awk '/userid/{print $2}' | xargs kill
to be executed from root. this works well on most commercial unix systems, have not tried on linux systems.
defaults write com.apple.dock persistent-others -array-add '{tile-data={}; tile-type="spacer-tile";}'; killall Dock
Add spacer to right side of Dock
Insert an additional (moveable) spacer on the right side of the Dock in Mac OS X
curl http://my-ip.cc/host.txt
ipv4: 188.165.241.33
hostname: ns390090.ovh.net
city: Roubaix
country: FRANCE (FR)
latitude: 50.7
longitude: 3.1667
Additionally it may give your geolocation if it's known by hostip.info
lame -m j -V 4 -q 0 --lowpass 17 -b 128 --cbr "infile" "128/outfile"
Convert a mp3 file to CBR 128 kbps high quality
This converts a mp3 file "infile" to a CBR 128 kbps high quality (according to Winamp) mp3 "128/outfile", joint-stereo, using LAME.
lam -f 1.4 myfile
setg
# ht
# ma
manp
# sa
# Th
samp
# re
read
Laminate files line by line
Lam is a command available on Bsd (I've tested it on OpenBSD).Is useful for laminate a file line by line. The -f option set the field width ( -f min.max ).
pax -r -s ',^/,,' -f file.tar
$ tar tvf test.tar
drwxr-xr-x u4x6691/unixadm 0 2009-06-26 15:39 /tmp/test/
-rw-r--r-- u4x6691/unixadm 0 2009-06-26 15:39 /tmp/test/a
-rw-r--r-- u4x6691/unixadm 0 2009-06-26 15:39 /tmp/test/b
-rw-r--r-- u4x6691/unixadm 0 2009-06-26 15:39 /tmp/test/c
$ pax -r -s ',^/,,' -f ./test.tar
$ ls -l tmp/
drwxr-xr-x 2 u4x6691 unixadm 4096 Jun 26 15:39 test
$ ls -l tmp/test/
-rw-r--r-- 1 u4x6691 unixadm 0 Jun 26 15:39 a
-rw-r--r-- 1 u4x6691 unixadm 0 Jun 26 15:39 b
-rw-r--r-- 1 u4x6691 unixadm 0 Jun 26 15:39 c
Functions: pax
Untar file with absolute pathname to relative location
man perlcheat | col -b > perlcheat.txt
Functions: col man
seq 4|xargs -n1 -i bash -c "echo -n 164.85.216.{} - ; nslookup 164.85.216.{} |grep name"|tr -s ' ' ' '|awk '{print $1" - "$5}'|sed 's/.$//'
164.85.216.1 - station1.domain.biz
164.85.216.2 - station2.domain.biz
164.85.216.3 - station3.domain.biz
164.85.216.4 - station4.domain.biz
Functions: awk bash sed seq tr xargs
Command to resolve name from Ip address, passing only the last field after seq (C Class for example)
for file in *.png; do mogrify -trim "$file"; done
open -a Finder
wget -qO- "http://www.amazon.com/b?ie=UTF8&node=163856011" | grep Daily | sed -e 's/<[^>]*>//g' -e 's/^ *//' -e 's/\&[^;]*;/ /'
AmazonMP3 Daily Deals
grabs and prints the AmazonMP3 daily album deal
mysql -u root -p -e"show processlist;"|awk '{print $3}'|awk -F":" '{print $1}'|sort|uniq -c
4 host03.xyz.com
7 host09.xyz.com
1 localhost
3 host12.xyz.com
Functions: awk uniq
This command will help you to find how many number of connection are made to given mysql and what are the different hosts connected to it with number of connection they are making.
psg() { if [ -z "$2" ]; then psargs="aux"; greparg="$1"; else psargs="$1"; greparg="$2"; fi; ps $psargs | grep -i "$(echo $greparg | sed -e 's/^\(.\)/[\1]/')\|^$(ps $psargs | head -1)" ; }
den:~ dre$ psg ssh
USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND
psg (ps grep) function if you don't have pgrep or don't know how to use it
My variant on this common function. Some highlights:
Allows you to override the default ps args of "aux"
Uses bracket trick to omit the grep process itself without having to use a second grep
Always prints the correct header row of ps output
Limitations: Ugly ps error output if you forget to quote your multi word grep argument
for file in *.foo; do gzip "$file"; done
It gzip each file in a directory separately
fetchmail -p etrn --fetchdomains yourdomain.example.org secondary-server.example.org
fetchmail: Queuing for yourdomain.example.org started
fetchmail: Polling secondary-server.example.org
Functions: fetchmail
Start delivery of mail queued on a secondary mail server.
This uses fetchmail to issue an etrn command that causes the MTA on the secondary mail server to process the queue for the specified domain.
You can also just use telnet or nc to connect to port 25 of the server and then:
etrn yourdomain.example.org
grep -l foo *cl*.log | xargs grep -lL bar
find files that contain foo, but not bar
same as
grep -lL "foo" $(grep -l bar *cl*.log)
defaults write com.apple.terminal FocusFollowsMouse -string YES
Terminal window focus on mouseover (mimicking X11 behavior) in Mac OS X
In Mac OS X, by default, you have to click the mouse on a Terminal window before you can type in it. You can change this behavior to mimic the X11 behavior of focusing on the window on mouseover.
curl http://my-ip.cc/host.json
"host": {
"ipv4": "188.165.241.33",
"hostname": "ns390090.ovh.net",
"address": {
"city":"Roubaix",
"country":"FRANCE (FR)",
"geo": {
}
JSON version.
stat --format "%s"
mysql -u root -p -N -e"show processlist\G;" | egrep "Host\:" | awk -F: '{ print $2 }' | sort | uniq -c
Functions: awk egrep sort uniq
clear; for i in `cat thehosts` ; do ssh $i "cat uname -a ; /etc/redhat-release; cat /proc/cpuinfo | tail -n 25 | egrep '^processor|^model name' "; free ; df -h ;done
Functions: clear df free ssh
‹ First < 247 248 249 250 251 > Last ›
fdisk -l |grep -e '^/' |awk '{print $1}'|sed -e "s|/dev/||g"
hdc1
hdc2
hdc5
hdd1
hdd2
hdd5
Functions: awk fdisk grep sed
curl -s -c /tmp/cookie -k -u tivo:$MAK --digest http://$tivo/download/$filename | tivodecode -m $MAK -- - | mplayer - -cache-min 50 -cache 65536
Watch a TiVo File On Your Computer
Watch a TiVo file on your computer.
find . -name '*.xml' -type f -print | xargs du -ch
nathan@juttenheim:~$ find . -name '*.xml' -type f -print | xargs du -ch
0 ./ma.xml
0 ./derp.xml
482M ./artbeads.xml
482M total
get disk usage sum for files of type
print sum of disk usage for filetype within current dir and subdirs
rm -- -i
Specify a file name that starts with hyphen, e.g. "-i"
If you just try rm -i, the file name will be interpreted as a command line switch. Many commands let you use a double hyphen '--' to say 'No more switches, the rest are file names'.
Incidentally having a file named '-i' in a directory where you use rm * will cause rm to act as if you specified '-i' on the command line.
vim -- -v touch -- -t cat -- -c
svn log -r{2011-08-01}:HEAD|awk '$14 ~/line/ {print $3}'|sort|uniq -c
List svn commits by user for a date range
My script lists all users & the number of commits they made in the period, sorted alphabetically. To sort by number of commits, append a '|sort' to the end of the command. The script depends on the output format of svn log - original command didn't work for me because the string 'user' was not appearing in my output
rpm -qa | grep PACKAGENAME | xargs rpm -q --filesbypkg
bash /bin/bash
bash /bin/sh
bash /etc/skel/.bash_logout
bash /etc/skel/.bash_profile
bash /etc/skel/.bashrc
bash /usr/bin/bashbug-32
bash /usr/share/doc/bash-3.1
bash /usr/share/doc/bash-3.1/CHANGES
bash /usr/share/doc/bash-3.1/COMPAT
bash /usr/share/doc/bash-3.1/FAQ
bash /usr/share/doc/bash-3.1/INTRO
bash /usr/share/doc/bash-3.1/NEWS
Functions: grep rpm xargs
search installed files of package, that doesn't remember his name well. On rpm systems
rpm, sometimes, is not wildcard friendly. To search files installed from package this could be useful.
change PACKAGENAME to any package do you want to search
echo "encryptedpassword"|openssl passwd -1 -stdin
Generate secure password to userwith chpasswd
echo $SSH_CLIENT | cut -f 1 -d ' '
host -i `echo $SSH_CLIENT | cut -f 1 -d \ ` | sed 's/.* domain name pointer \(.*\)\./\1/'
to reverse lookup and get the hostname.
xmms `python -c "print \"tone://\" + \";\".join([str(22*(2**x)) for x in range(9)])"`
Make a pipe organ sound using XMMS and Python
You can get XMMS from here if it's not in your repositories:
http://www.xmms.org/
S=`pidof skype`;grep heap /proc/$S/maps|cut -f1 -d' '|awk -F- '{print "0x" $1 " 0x" $2}'|xargs echo "du me t ">l;gdb -batch -p $S -x l>/dev/null 2>&1;strings t|grep \(smirk|head -n1
(...) |\(banghead\)|\(bear\)|\(beer\)|\(blush\)|\(bow\)|\(bricklayers\)|\(brokenheart\)|\(bug\)|\(bye\)|\(cake\)|\(call\)|\(cash\)|\(chuckle\)| (...)
Functions: awk cut echo grep head xargs
Extract the emoticons regex from a running skype process
Skype has an internal regex which depicts the emoticons it supports. However you cannot simply search the binary file for it. This small 181 character line will do just that, provided skype is running. And of course, only works in linux.
$(while [ ! -z "$(pgrep rsync)" ]; do echo; done; echo "rsync done" | mailx user@example.com) > /dev/null &
Will email user@example.com when all Rsync processes have finished.
This will email user@example.com a message with the body: "rsync done" when there are no processes of rsync running. This can be changed for other uses by changing $(pgrep rsync) to something else, and echo "rsync done" | mailx user@example.com to another command.
Split() { SENT=${*} ; sentarry=( ${SENT} ) ; while [[ ${#sentarry[@]} -gt 0 ]] ; do printf "%s\n" "${sentarry[0]}" ; sentarry=( ${sentarry[@]:1} ) ; done ; }
(for i in `find . -maxdepth 2 -name .svn | sed 's/.svn$//'`; do echo $i; svn info $i; done ) | egrep '^.\/|^URL'
./www.example.com/
URL: https://svn.example.com/example/trunk
./www2.example.com/
URL: https://svn.example.com/example2/trunk
Functions: echo egrep info sed
If you have lots of svn working copies in one dir and want to see in which repositories they are stored, this will do the trick.
If you have lots of subversion working copies in one directory and want to see in which repositories they are stored, this will do the trick. Can be convenient if you need to move to a new subversion server.
echo Good $(i=`date | cut -d: -f1 | cut -d' ' -f4-4` ; if [ $i -lt 12 ] ; then echo morning ; else if [ $i -lt 15 ] ; then echo afternoon ; else echo evening ; fi ; fi)
Good evening
Good morning
Get the hour and greet the user!
Make sure you add this to your bashrc, for a pleasant hacking experience!
date +%Y%m%d%T -s "`ssh user@server 'date "+%Y%m%d %T"'`"
2011011110:28:12
If you are stuck behind a firewall and want to synchronize time with another server but you do not want to port forward NTP (which uses UDP) then this command is handy. It gets the time from a server and sets the local time. It is not that accurate but I can live with a second or so drift.
ipcs -ma | awk '/^m / { if ($9 == 0) { print $2 }}' | xargs -n 1 ipcrm -m
Functions: awk ipcrm ipcs xargs
Remove all unused shared memory segments for current user
It can work for message queue, semaphore set or shared memory just changing the parameter.
for f in *.rar;do unrar e ?$f?;done
$for f in *.rar; do unrar e "$f"; done
UNRAR 3.80 beta 2 freeware Copyright (c) 1993-2008 Alexander Roshal
Extracting from file.rar
Extracting file.pdf OK
All OK
Unrar all files in a directory
Great for sites like Gigapedia.org that give away great free rar'd books.
More similar commands here: http://www.howtogeek.com/howto/ubuntu/unzip-or-unrar-many-files-at-once-in-linux/
while true; do clear; nmap ${hostname} -PN -p ${hostport}; sleep 5; done
Starting Nmap 4.76 ( http://nmap.org ) at 2009-08-14 22:14 CEST
Interesting ports on 192.168.0.1:
checks if host /service is up on a host that doesn't respond to ping
the command for the impatient sysadmin: simply checks every five secs, if a host or a specific service running on it is up. ideal for hosts that are configured not to respond on pings.
export PS1="(\@) $PS1"
(10:34 AM) [@ ]$
Add the time to BASH prompt
Adds the time in 12hr AM/PM format to the beginning of a prompt. Change \@ to \t for 24-hour time or \T for 12hr without AM/PM.
To keep the time the next time you open a terminal, edit ~/.bashrc and stick the command at the bottom.
tcpdump -w "$(sed 's/-//gi; s/ /_/gi'<<<"-vvv -s0 -ieth1 -c10 icmp").pcap"
Make a quick network capture with tcpdump to a file - filename based on tcpdump arguments
The tcpdump arguments are just an example.
tcpdump -nr capture.file | awk '{print }' | grep -oE '[0-9]{1,}.[0-9]{1,}.[0-9]{1,}.[0-9]{1,}' | sort | uniq -c | sort -n
Functions: awk grep sort tcpdump uniq
get useful statistics from tcpdump (sort by ip)
We can get useful statistics from tcpdump with this simple command.
Thanks "Babak Farrokhi" to teaching me this ;)
print a file on a single line
Example: you have a package.txt you want to install on a system. Instead of this:
cat package.txt
package1
package2
package3
You want it to cat out on one line so you can print "yum install package1 package2 package3"
less file.tar.gz
View the list of files and directories in an archive with less.
This will print out the files and directories in a gzipped tarball.
tail -f FILE | grep --color=always KEYWORD
colored tail
grep xxxx messages | cut -d ' ' -f 1,2,3
Apr 28 23:11:28 HUI100404 Node restarted with memory dumped successfully.
=>Apr 28 23:11:28
Get the date field from syslog for a certain set of events
first greps syslog for certain events (grep xxxx messages) then displays the 1st 2nd and 3rd fields (-f 1,2,3) seperated by space(-d ' ')
‹ First < 248 249 250 251 252 > Last ›
whois -H $(cat ./list_of_domains) | awk 'BEGIN{RS=""}/Registrant/,/Registration Service Provider:/ {print} END{print "----------------\n"}'
Functions: awk cat whois
List contact infomation for Domain list
Nice neat feedback showing contact infomation for as many domains as you wish to feed it. I used a list of domains, each one on a new line as supplied by our registar, as we needed to check they were all upto date and back them up as we are updating them all.
while :; do OLD=$NEW; NEW=`cat /proc/net/dev | grep eth0 | tr -s ' ' | cut -d' ' -f "3 11"`; echo $NEW $OLD | awk '{printf("\rin: % 9.2g\t\tout: % 9.2g", ($1-$3)/1024, ($2-$4)/1024)}'; sleep 1; done
openssl pkcs12 -export -in /dir/CERTIFICATE.pem -inkey /dir/KEY.pem -certfile /dir/CA-cert.pem -name "certName" -out /dir/certName.p12
Create a P12 file, using OpenSSL
echo "import this" | python
Very very cool list of quotations and directives on pythonic programming. I love them and they are sure applicable in C++ too, and for most any programming, really.
echo "5 k 3 5 / p" | dc
.60000
using bc is for sissies. dc is much better :-D
Polish notation will rule the world...
Putty -d 8080 [server]
Proxy all web traffic via ssh
Run this on a windows machine then add your localhost as a socks server for port 8080 within your web browser. Your traffic will now be proxying and sent via your server over ssh.
geo(){ curl -s "http://www.geody.com/geoip.php?ip=$(dig +short $1)"| sed '/^IP:/!d;s/<[^>][^>]*>//g'; }
$ geo printifier.com
IP: 67.199.102.91 Location: Ashburn, VIRGINIA, United States (UUNET Technologies, Inc.)
A function that takes a domain name as an argument
find -name 'foo*' | while read i; do echo "$i"; done
/some/directory/foobar
/some/directory/foo bar
/some/directory/sub dir/foo baz
Loop over files found using 'find' (works with filenames that contain spaces)
Replace the echo command with whatever commands you want.
'read' reads a line from stdin and places the text in the variable, the stdin of the while loop comes from the find command.
Note that with simple commands, an easier way is using the '-exec' option of find. My command is useful if you want to execute multiple commands in the loop.
cd /proc&&ps a -opid=|xargs -I+ sh -c '[[ $PPID -ne + ]]&&echo -e "\n[+]"&&tr -s "\000" " "<+/cmdline&&echo&&tr -s "\000\033" "\nE"<+/environ|sort'
[32447]
/usr/bin/screen -A -D -r -a -S sh-srot -T xterm-256color -O -l
AA_P=export PVE="\033[m\033[38;5;2m"$((`sed '2!d;s/[^0-9]*//g' /proc/meminfo`/1024))"\033[38;5;22m/"$((`sed '1!d;s/[^0-9]*//g' /proc/meminfo`/1024))MB"\t\033[m\033[38;5;55m$(< /proc/loadavg)\033[m";echo -en ""
CR=E(BE[mE[!pE[?3;4lE[4lE>
GROUPNAME=srot
G_BROKEN_FILENAMES=1
HISTCONTROL=ignoreboth
HISTFILE=/home/askapache/.bk/.history/.bash_history
HISTFILESIZE=5000
HISTIGNORE=cls:reset:clear:ls:ll:lll:l:pwd:env:printenv:lsof:updatedb:h2:h1:h3:dir:cd ..:date:exit:aa_screen
HISTSIZE=1000
HOME=/home/askapache
HOSTNAME=www.askapache.com
IFS=
INPUTRC=/etc/inputrc
LANG=C
LESSCHARSET=latin1
LESSOPEN=|/usr/bin/lesspipe.sh %s
LOGNAME=askapache
N6=/dev/null
PAGER=less
PATH=/bin:/usr/bin:/usr/local/bin:/sbin:/usr/sbin:/usr/local/sbin:/usr/kerberos/bin:/usr/libexec
PF=%.5m %10M %#15s %#9u:%-9g %#5U:%-5G [%AD | %CD | %TD] [%Y] %p\n
PKG_CONFIG_PATH=/usr/lib/pkgconfig:/usr/local/lib/pkgconfig
PROMPT_COMMAND=history -a;(($SECONDS % 10==0 ))&&eval "$AA_P";echo -en "$PVE"
PS1=\[\e[m\n\e[1;30m\][$$:$PPID \j:\!\[\e[1;30m\]]\[\e[0;36m\] \T \d \[\e[1;30m\][\[\e[1;34m\]\u@\H\[\e[1;30m\]:\[\e[0;37m\]${SSH_TTY/\/dev\/} \[\e[0;32m\]+${SHLVL}\[\e[1;30m\]] \[\e[1;37m\]\w\[\e[0;37m\]\n\$
PVE=\033[m\033[38;5;2m1849\033[38;5;22m/2048MB\t\033[m\033[38;5;55m1.09 1.25 0.90 1/66 15024\033[m
PWD=/home/askapache
R=E[?12lE[?25hE[27mE[24mE(BE[m
SHELL=/bin/bash
SHLVL=1
TERM=xterm-256color
TMPDIR=/tmp
TZ=America/Indiana/Indianapolis
USER=askapache
_=/usr/bin/screen
Functions: cd sh xargs
View All Processess Cmdlines and Environments
Grabs the cmdline used to execute the process, and the environment that the process is being run under. This is much different than the 'env' command, which only lists the environment for the shell. This is very useful (to me at least) to debug various processes on my server. For example, this lets me see the environment that my apache, mysqld, bind, and other server processes have.
Here's a function I use:
aa_ps_all () { ( cd /proc && command ps -A -opid= | xargs -I'{}' sh -c 'test $PPID -ne {}&&test -r {}/cmdline&&echo -e "\n[{}]"&&tr -s "\000" " "<{}/cmdline&&echo&&tr -s "\000\033" "\nE"<{}/environ|sort&&cat {}/limits' ); }
From my .bash_profile at http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html
find -name "" | xargs -i cp -avfr --parent {} /
copy selected folder found recursively under src retaining the structure
This command will a particular folder-name recursively found under the src-path-to-search to the dest-path-to-copy retaining the folder structure
N=10; echo "($N*($N+1)*(2*$N+1))/6" | bc
Simplified the series to a polynomial and send it to bc
killall -s 9 krunner_lock
With this you can unlock your KDE4 session via SSH, via mobile phone SSH or e. g. scheduled task in crontab (without asking password). Useful when you need to grant somebody access to your locked profile remotely.
Create an alias (e. g. as "unlock") and use with remote KDE4 lock.
This works only on KDE4 boxes because KDE 3 is using utility with another name.
in bash hit "tab" twice and answer y
List all available commands
rcsdiff -y myfile
rcsdiff: Output the differences side-by-side
Use -W to adjust the width of the output, and --suppress-common-lines to show only the lines that have been changed.
ls *.zip|awk '{$a="zip -fo "$1" FILENAME"; system($a);}'
- all zips are in current folder
- FILENAME is file name that should be subsitute in all zips (new version of this file is in current folder)
curl pagerank.bz/yourdomain.com
Get Google PageRank
via http://pagerank.bz/
tar czf git_mods_circa_dec23.tgz --files-from <(git ls-files -m)
Create tarball of files modified in git
HandBrakeCLI -i video.avi -o video.mp4
http://handbrake.fr/
ack -a -G '^(?!.*bar/data.*).*$' pattern
Ignore a specific subdir, instead of all subdirs, with ack-grep
Say you have a directory structure like "foo/, foo/data/, bar/, bar/data/". If you just want to ignore 'bar/data' and you use "ack --ignore-dir=data pattern" it will ignore both foo/data and bar/data and 'ignore-data=bar/data' etc won't work.
dpkg -l | grep ^rc | cut -d' ' -f3 | xargs dpkg -P
Functions: cut grep xargs
Lists all packages in "rc" state and purge them one at a time.
while sleep 1; do echo -n "\r`date`"; done
Replace all occurences of a pattern with another one from previous command
amixer -c 0 set Master 1+ unmute
Functions: amixer set
amixer : raise volume and unmute if necessary
Volume up und unmute (ignored if Master is not muted).
Replace "+" by "-" for volume down and unmute if necessary.
x11vnc -storepasswd your_new_apssword ~/my_vnc_pass
Create x11vnc server authentication file
This will generate a password file to use with x11vnc server, obviously you should replace "your_new_password" with the password you want to use and the path where you want to store it.
export-opml(){ curl -sH "Authorization: GoogleLogin auth=$(curl -sd "Email=$1&Passwd=$2&service=reader" https://www.google.com/accounts/ClientLogin | grep Auth | sed 's/Auth=\(.*\)/\1/')" http://www.google.com/reader/subscriptions/export; }
Export OPML from Google Reader
‹ First < 249 250 251 252 253 > Last ›
a2p -F:
a2p converts awk scripts to perl programs
while :;do if [ ! $(ls -l commander |cut -d ' ' -f5) -eq 0 ]; then echo "Ran command: $(less commander) @ $(date +%D) $(date +%r)" >> comm_log;"$(less commander)";> commander;fi;done
Functions: cut echo ls
A way to run commands on a remote computer to be displayed on the remote computer
This is a simple solution to running a remote program on a remote computer on the remote display through ssh.
1. Create an empty 'commander' file in the directory where you intend on running these commands.
2. Run the command
3. Hop on another computer and ssh in to the PC where you ran the command
4. cd to the directory where the 'commander' file is.
5. Test it by doing the following: echo "xeyes" > commander
6. If it worked properly, then xeyes will popup on the remote computer.
Combined with my other one liner, you can place those in some start-up scripts and be able to screw with your wife/daughter/siblings, w/e by either launching programs or sending notifications(my other one liner).
Also, creates a log file named comm_log in working directory that logs all commands ran.
socat TCP-LISTEN:locport,fork TCP:XXX.XXX.XXX.XXX:YYY,sourceport=srcport
cyrus@OMGWTF:~$ socat TCP-LISTEN:3333,fork TCP:192.168.2.2:80,sourceport=12345
Create a tunnel from a remote server to the local machine using a specific source port
It connects to XXX.XXX.XXX.XXX port YYY, using a source port of "srcport" and binds the tunnel on local port "locport". Then you can connect to localhost:locport.
With this command it's possible to connect to servers using a specific source port (useful when a firewall check the source port). Because of the connections starting from the same source port, this works well only for the first connection (for example, works well with SSH and bad with HTTP because of multiple requests).
* It requires socat
find . -type f -name '*.php' | xargs cat | sed -re ':top /\/\*.*\*\// { s/\/\*.*\*\///g ; t top }; /\/\*/ { N ; b top }' | awk '$0 !~ /^[\t[:space:]]*($|(\/\/)|(#))/' | wc -l
andre@klaus:~/CVS/unitime/unitimeweb/unitime$ find . -type f -name '*.php' | xargs cat | sed -re ':top /\/\*.*\*\// { s/\/\*.*\*\///g ; t top }; /\/\*/ { N ; b top }' | awk '$0 !~ /^[\t[:space:]]*($|(\/\/)|(#))/' | wc -l
419064
andre@klaus:~/CVS/unitime/unitimeweb/unitime$
Functions: awk cat find sed top wc xargs
How many lines in your PHP project without comments
An advanced possibility to count the lines of code like in #8394
curl -s "http://search.twitter.com/search?from=zurvollenstunde&rpp=1" | grep -E '(Es ist jetzt|ago)' | sed 's/<[^>]*>//g;s/[^[:digit:]]//g' | xargs | sed -e 's#\ #:#'
6:23
Get the rough (german) time from Twitter by @zurvollenstunde
This combines @zurvollenstunde's hourly tweets and the "n minutes ago" from Twitter search.
progr
[====>...........] 40%
progress bar for cp
while [ $orig_size -gt $dest_size ] ; do
dest_size=$(stat -c %s $2)
pct=$((( 69 * $dest_size ) / $orig_size ))
echo -en "\r["
for j in `seq 1 $pct`; do
echo -n "="
echo -n ">"
for j in `seq $pct 68`; do
echo -n "."
echo -n "] "
echo -n $((( 100 * $pct ) / 69 ))
echo -n "%"
$ pastebin(){ curl -s -S --data-urlencode "txt=$(cat)" "http://pastehtml.com/upload/create?input_type=txt&result=address";echo;}
$ cat test.file |pastebin
http://pastehtml.com/view/b9sge3in3.txt
Pipe the output of any command to pastehtml.com in text format
for i in `wget -O url|grep '[^<]\+.*|\1|'`;do if test -n "$(whois $i|grep -i godaddy)";then echo $i uses GoDaddy;fi;sleep 20;done
Functions: echo grep sed sleep whois
check a list of domains registered on godaddy
Found on https://bitcointalk.org/index.php?topic=55520.0
rsync -avz -e ssh username@hostname:/path/to/remote/dir/ /path/to/local/dir/
rsync over ssh
seq 10 |xargs -n1 echo Printing line
jeju:[xxxx] > seq 10 |xargs -n1 echo Printing line
Printing line 1
Printing line 2
Printing line 3
Printing line 4
Printing line 5
Printing line 6
Printing line 7
Printing line 8
Printing line 9
Printing line 10
jeju:[xxxx] >
Functions: echo seq xargs
Creating sequence of number with text
Nice command to create a list, you can create too with for command, but this is so faster.
x11vnc -display :0 -scale 6/7 -rfbauth vncpass -forever
Start the x11vnc server
This will start the x11vnc server, scale it at 6/7, will use the vncpass file to authenticate and wont shut down as soon as a client disconnects
{ echo -e "$body"; uuencode "$outfile" "$outfile"; } | mail -s "$subject" "$destaddr" ;
Functions: echo mail uuencode
on this way we can define the body too
:.,$!perl -pne 'for $i ("0001".."0004"){ s/XXXX/$i/ if($i == $.) }'
123|XXXX|1000
123|XXXX|1001
123|XXXX|1010
123|XXXX|1011
123|0001|1000
123|0002|1001
123|0003|1010
123|0004|1011
Create a series of incrementing numbers in vim
given lines of the form
each 'XXXX' will be replaced with a serial number between 0001 and 0004.
ssh -l
Login via SSH
portnum() { egrep "[[:space:]]$*/" /etc/services; }
[root#server][~]> portnum 25
Just use your system preinstalled file
free -g
srchpymod() { python -c "import $1; print filter(lambda x: x.find('$2') >= 0, dir($1))"; };
Matched symbols in the python module.
search into contents of python module
srchpymod
srchpymod cairo Surface
['ImageSurface', 'PDFSurface', 'PSSurface', 'SVGSurface', 'Surface', 'SurfacePattern', 'XlibSurface']
cp ./* .[!.]* ..?* /path/to/dir
Copy all files. All normal files, all hidden files and all files starting with - (minus).
./* is for copying files starting with -
.[!.]* is for copying hidden files and avoiding copying files from the parent directory.
..?* is for copying files starting with .. (avoids the directory ..)
/path/to/dir the path to the directory where the files should be copied
Can also be used as a script. Input argument is /path/to/dir
in tcsh, replace .[!.]* with .[^.]*
mvn -Declipse.workspace= eclipse:add-maven-repo
Eclipse needs to know the path to the local maven repository. Therefore the classpath variable M2_REPO has to be set.
Taken from - http://maven.apache.org/guides/mini/guide-ide-eclipse.html
xmlstarlet fo "http://www.google.com/ig/api?weather=$(curl -s api.hostip.info/get_html.php?ip=$(curl -s icanhazip.com)... SEE SAMPLE OUTPUT
xmlstarlet fo http://www.google.com/ig/api?weather=$(curl -s api.hostip.info/get_html.php?ip=$(curl -s icanhazip.com) | sed -e'1d;3d' -e's/C.*: \(.*\)/\1/' -e's/ /%20/g' -e"s/'/%27/g" -e"s/-/%2d/g") | sed -e's||Locale|' -e's||Today|' -e's|* | while read file; do scp $file user@host:/path/; if [[ $? -eq 0 ]]; then rm $file; fi; done'
Functions: read rm scp
Search filenames with given pattern; each one is transfered via scp and if succesfull the file is locally deleted. Ideal for filesystem quick maintenance
ffmpeg2theora input.avi
avi to ogv (Ogg Theora)
ffmpeg2theora
(http://v2v.cc/~j/ffmpeg2theora/)
sudo dscl localhost -append /Local/Default/Groups/admin GroupMembership username
Add user to group on OS X 10.5
adding users to groups on OS X is not a straightforward process, you need to use the new in built in Directory Service command line utility...
/usr/bin/truss /usr/bin/date 2>&1 | nawk -F= '/^time\(\)/ {gsub(/ /,"",$2);print $2}'
yes 'clear;printf "\n\n`date`\n" | figlet -f starwars;sleep 1' | sh
Console clock -- Beautiful
This will show a console clock with Figlet.
This is with the Star Wars font.
Change the -f option to anything else.
Notice: You need Figlet installed for this to work.
To install Figlet on Ubuntu, type in:
sudo apt-get install figlet
To install Figlet on Debian, type in:
aptitude install figlet
for R in `svn log file:///path/repo | grep ^r | grep dude | cut -d' ' -f1 | cut -dr -f2`; do svn ps svn:log --revprop -r $R "`svn pg svn:log --revprop -r $R file:///path/repo; perl -e 'print ".\n";' | fromdos`" file:///path/repo; done
property 'svn:log' set on repository revision ###
Functions: cut grep ps
Fix all the commit log messages from a user of a bad subversion client
Let's supose some moron used some m$ shit to commit to a later svnsynced repo. On a svn sync all his message logs cause a svnsync: Error setting property 'log': this commands finds all its contributions and fix all his commit logs
apt-get remove $(dpkg -l | awk "/^ii linux-(image|headers)/ && ! /`uname -r`/ {print \$2}")
Functions: apt awk
since awk was already there one can use it instead of the 2 greps. might not be faster, but fast enough
ettercap -i wlan0 -T -q -P dns_spoof -M ARP:remote // //
This command will enable dns spoofing through ettercap. The etter.dns config file must be set. The -i parameter defines the interface, e.g. eth0, eth1, wlan0...
ettercap -h for more info
Credit goes to xhabie-crew
brew update && brew install `brew outdated`
More information about what homebrew is all about: http://github.com/mxcl/homebrew
find . -name "*.html" -exec grep -l 'string' {} \;
./filename1.html
./directory1/filename2.html
Find given string in all files with given name or extension
This will search for "string" in all files under the given path "." and provide a listing of the files with their relative locations.
echo Good $(i=`date +%H` ; if [ $i -lt 12 ] ; then echo morning ; else if [ $i -lt 15 ] ; then echo afternoon ; else echo evening ; fi ; fi)
Saves all the "cut" hacks
( di $TOFSCK -h ; /bin/umount $TOFSCK ; time /sbin/e2fsck -y -f -v $FSCKDEV ; /bin/mount $TOFSCK ) |& /bin/mail $MAILTO -s "$MAILSUB"
Filesystem Mount Size Used Avail %Used fs Type
e2fsck 1.41.12 (17-May-2010)
Pass 1: Checking inodes, blocks, and sizes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
22256269 blocks used (77.18%)
--------
real 3m31.842s
user 0m13.897s
sys 0m8.977s
Easy to extend one-liner for cron scripts that automate filesystem checking
This one-liner is for cron jobs that need to provide some basic information about a filesystem and the time it takes to complete the operation. You can swap out the di command for df or du if that's your thing. The |& redirections the stderr and stdout to the mail command.
How to configure the variables.
TOFSCK=/path/to/mount
FSCKDEV=/dev/path/device
FSCKDEV=`grep $TOFSCK /proc/mounts | cut -f1 -d" "`
MAILSUB="weekly file system check $TOFSCK "
perl -le 'print time()'
svnradd() { for i in $1/*;do if [ -e "$i" ];then if [ -d "$i" ];then svn add $i;svnradd $i;else svn add $i;fi; fi;done }
SVN Recursive Directory/File Adder
This will recursively add files/directories in SVN.
svnradd yourfile
svnradd yourdirectory
then:
svn commit
Notice: It might not work properly, and not all files could get added.
Since there is a limit on characters, I couldn't add failure/success notices.
If you want failure/success notices, download Terminal Enhancements (http://tenhancements.tk/ )
It is included on Base Features
psbook file.ps | psnup -2 -l -m0.5cm | pstops '2:0,1U(210mm,297mm)' > file.booklet.ps
Create a booklet ps file out of a normal ps (A4 Size)
'booklet' is the name they'll give it in fineprint windows alternative. It's a postscript file prepared to be printed dual side, one page per sheet, and, once finished you can place staples in the middle of the print, fold, and read it like a book.
mencoder input.m2ts -oac mp3lame -lameopts cbr:br=128 -ofps 24 -vf harddup -vf scale=1280:720 -ovc xvid -xvidencopts fixed_quant=3 -o output.xvid.lamp.avi
mencoder convert bluray to xvid
grep -c '^$' /proc/cpuinfo
All Linux Systems I try also have an empty line per cpu in /proc/cpuinfo... little shorter then...
pgrep -f 'process.*argument.*'
Get process id based on name and parameters
slice="-rw-r--r-- "; ls -l | cut -c $(echo "$slice" | wc -c)-
Functions: cut echo ls wc
slice a fixed number of characters from the output of a command, where the width of the slice is the number of characters in $slice
‹ First < 251 252 253 254 255 > Last ›
sed 's/.*/ /'
The first version printed:
tr: empty string2
The second version printed:
sed: -i may not be used with stdin
Maybe I misunderstood the orginal problem.
cobbler repo edit --name=Epel-i386 --environment="http_proxy=http://100.100.100.100:3128"
Configuring a proxy for a cobbler repo
This is the command to configure "cobbler reposync" to use a specific proxy setting to mirror locally the content of a specific remote repository.
find * ! -name abc -delete
imap r =system('echo "$(($RANDOM % 100))"')
75
Map \r do insert random number in vim
This mapping function is called RANDOM bash and enter a number between 1 and 100
yes 'clear;printf "`date`\n" | figlet -f starwars | boxes;sleep 1' | sh
Console clock -- Beautiful 2
This is a different version from my original command: Console clock -- Beautiful (http://www.commandlinefu.com/commands/view/7902/console-clock-beautiful )
This one uses Boxes and Figlet.
To install the dependencies on Ubuntu, type in:
sudo apt-get install boxes figlet
To install the dependencies on Debian, type in:
aptitude install boxes figlet
netstat -an |grep ":80" |awk '{print $5}' | sed s/::ffff://g | cut -d: -f1 |sort |uniq -c |sort -n | tail -1000 | grep -v "0.0.0.0"
11 113.179.81.247
11 58.187.233.193
12 113.172.21.164
12 113.23.83.98
14 115.78.193.153
15 123.26.19.210
15 71.22.46.17
16 125.234.144.101
17 113.22.133.104
17 1.54.1.201
Functions: awk cut grep netstat sed sort tail uniq
Find all IP connected to my host through TCP connection and count it
Count and Find all IP connected to my host through TCP connection.
sudo dpkg -i `ls -tr *.deb | tail -n4`
Functions: sudo tail
Install 4 new package files
after kernel build with make deb-pkg, I like to install the 4 newest packages that exist in the directory. Beware: might be fewer for you....
sgdisk /dev/sda -R /dev/sdb && sgdisk -G /dev/sdb
copy GPT partition table from /dev/sda to /dev/sdb
copy GPT partition table from /dev/sda to /dev/sdb, using gptfdisk from http://sourceforge.net/projects/gptfdisk/. The -G command randomizes the UUIDS
su -c "truecrypt --non-interactive truecrypt-file cryptshare -p PASSWORD"
Mount a truecrypt drive from a file from the command line non-interactively
This is useful for use in scripts.
Note that this will leak your password to ps, so this shouldn't be used on shared machines. Use key files for this
printf '%*s\n' 20 | tr ' ' '#'
Emulate perl 'print "#" x 20, "\n"'
slice(){ cut -c$((${#1}+1))-; }; ls -l | slice "-rw-r--r--"
mergepdf() { gs -q -dNOPAUSE -dBATCH -sDEVICE=pdfwrite -sOutputFile=merged.pdf "$@" }
Merge PDFs with Ghostscript wrapped in a function
This is an expansion on a previous entry, which I've wrapped in a function and placed in my profile. The "$@" is a positional parameter, much like "$*", but the parameters are passed on intact, without interpretation or expansion; so you can simply call the function like this:
mergepdf *
This will output a merged PDF of all PDFs in the current directory. Alternatively, you can simply list them like so:
mergepdf 00.pdf 01.pdf 02.pdf ...
N.B. Passing a wildcard will merge all PDFs in the current directory in name order, e.g. 00.pdf 01.pdf aa.pdf ab.pdf
lynx --dump "http://www.google.com.br" | egrep -o "http:.*"
http://www.google.com.br/imghp?hl=pt-BR&tab=wi
http://video.google.com.br/?hl=pt-BR&tab=wv
http://maps.google.com.br/maps?hl=pt-BR&tab=wl
http://news.google.com.br/nwshp?hl=pt-BR&tab=wn
http://www.orkut.com/Main?hl=pt-BR&tab=w0#Home
http://www.google.com.br/intl/pt-BR/options/
http://www.google.com.br/url?sa=p&pref=ig&pval=3&q=http://www.google.com.br/ig%3Fhl%3Dpt-BR%26source%3Diglk&usg=AFQjCNEufhwNAC9POZqcS5r7r07CUPbvAA
http://www.google.com.br/preferences?hl=pt-BR
http://www.google.com.br/
http://www.google.com.br/advanced_search?hl=pt-BR
http://www.google.com.br/language_tools?hl=pt-BR
http://www.google.com.br/intl/pt-BR/ads/
http://www.google.com.br/services/
http://www.google.com.br/intl/pt-BR/about.html
http://www.google.com/ncr
http://www.google.com.br/intl/pt-BR/privacy.html
Get all URLs from webpage via Regular Expression
Get all URLs from website via Regular Expression... You must have lynx installed in your computer to execute the command.
--> lynx --dump "" | egrep -o ""
- Must substitute it for the website path that you want to extract the URLs
- Regular Expression that you wanna filter the website
for i in ${TOILET_FONT_PATH:=/usr/share/figlet}/*.{t,f}lf; do j=${i##*/}; toilet -d "${i%/*}" -f "$j" "${j%.*}"; done
mmm mmm mmm mmm mmm #" "m
" # # " #" " # # #m m#
m"""# """m # # # """ #
"mm"# "mmm" "#mm" mm#mm mm#mm "mmm"
host -la domain.com
Perform a dns zone transfer (if is allowed on target dns server) and print result.
mencoder -ovc lavc -lavcopts vcodec=mpeg4:vbitrate=1000:vhq -oac mp3lame -lameopts br=98 -o output.wmv input.mpg
Convert video type from mpg to wmv
range () { end=$(echo "$1 + $2 - 1" | bc); echo "$1-$end"; }
shell function to turn start and length in to a range suitable for using in cut.
echo "..1234567." | cut -c $(range 3 7)
yields
find ~/Music/iTunes/iTunes\ Media/. -name \*.ipa -exec basename {} \; | cut -d \. -f 1 > ~/Desktop/MyAppList`date +%s.txt`
1Password
3D Chess Free
Adobe? Ideas 1
AIM for iPad
Anaconda XL
Anagram
Arabic Alphabet Reference and Quiz
ascii2bin
[ cut for brevity ]
Functions: basename cut find
print your iTunes App for iPhone/iTouch/iPad to show your friends which ones you have
omit "> ~/Desktop/MyAppList`date +%s.txt`" if you don't want to print it to a file on your desktop and instead only want to display to console
created and tested on:
ProductName: Mac OS X
ProductVersion: 10.6.3
BuildVersion: 10D573
find * ! -name abc -type f -delete
find /path/to/folder/ -mindepth 1 -maxdepth 2 -name "*,v" -exec sudo rlog -L -R {} \;
/etc/RCS/fstab,v
find rcs locked file in a given folder
find the files locked by rcs utility
curl -s http://www.cavejohnsonhere.com/random/ | grep quote_main | cut -d \> -f 2- | fmt -w $(tput cols)
Alright, I've been thinking. When life gives you lemons, don't make lemonade -
make life take the lemons back! Get mad! I don't want your damn lemons, what am
I supposed to do with these? Demand to see life's manager. Make life rue the
day it thought it could give Cave Johnson lemons. Do you know who I am? I'm
the man who's gonna burn your house down! With the lemons. I'm going to to
get my engineers to invent a combustible lemon that burns your house down!
Functions: cut fmt grep tput
The wisdom of Cave Johnson
There's been a similar Futurama thing around for a while, which grabs a quote from the /. headers [curl -Ism3 slashdot.org | egrep "^X-(F|B|L)" | cut -d \- -f 2- | fmt -w $(tput cols)]. Same deal, but more likely to stop working when someone forgets to pay the bill on the domain. Until then: Cave Johnson!
parallel echo -n {}"\ "\;echo '$(du -s {} | awk "{print \$1}") / $(find {} | wc -l)' \| bc -l ::: *
yeslab.org 300.32786885245901639344
theyesmen.org 679.16801687505732016752
Functions: awk bc du echo find wc
Compute the average number of KB per file for each dir
Use this to find identify if dirs mostly contain large or small files.
ls -l `whereis gcc`
ls: cannot access gcc:: No such file or directory
lrwxrwxrwx 1 root root 7 2011-03-03 00:31 /usr/bin/gcc -> gcc-4.5
lrwxrwxrwx 1 root root 7 2011-03-03 00:31 /usr/bin/X11/gcc -> gcc-4.5
/usr/lib/gcc:
drwxr-xr-x 3 root root 4096 2011-02-14 18:01 i586-suse-linux
whereis (1) - locate the binary, source, and manual page files for a command
Not actually better, just expanded a bit. The "whereis" command has the following output:
whereis gcc
gcc: /usr/bin/gcc /usr/lib/gcc /usr/bin/X11/gcc /usr/share/man/man1/gcc.1.gz
therefore the 'ls' error on first line, which could be eliminated with a little extra work.
ls **/fred*~*junk*/*
List all files fred* unless in a junk directory
for i in ~/Desktop/Personal/Wallpapers/*.jpg ; { size=$((`identify -format "%wx%h" $i | sed 's/x/*/'`)) ; if [[ $size -lt 800001 ]] then ; rm -f "$i" ; fi; }
Functions: rm sed
A quick shell command to weed out the small wallpapers
For all of the jpgs in a directory, determine their size and if below a threshold remove them forcefully.
‹ First < 252 253 254 255 256 > Last ›
metascore(){ curl -s "http://www.metacritic.com/$@" | sed -rn 's|\t*([^<]*)|\1|p'; }
Get a metascore from metacritic.com
This will fetch a metascore from metacritic.com.
It requires a url from metacritic without the http://www.metacritic.com/
metascore games/platforms/wii/supermariogalaxy
metascore tv/shows/marriageref
metascore video/titles/newmoon
Would be cool to use this in some sort of a graph.
rsync --delete -az -e 'ssh -c blowfish -i /your/.ssh/backup_key -ax' /path/to/backup remote-host:/dest/path/
remote backups with rsync
while read line; do pais=$(whois "$line" | grep -E '[Cc]ountry') echo -n "IP=$line Pais=$pais" && echo done output) 2>&1 | zenity --progress
Track progress of long-running text-command using graphical dialog
TEST_UUID=$(blkid /dev/sda6 | sed -rn "s/^.*UUID=\"([a-z0-9]{8}-[a-z0-9]{4}-[a-z0-9]{4}-[a-z0-9]{4}-[a-z0-9]{12})\".*/\1/p")
Put uuid of disk into variable
xxx.xxx.xx.xx
Get your external public IP address
Grabs your external public IP.
for FILE in $(svn status | grep ? | grep .php); do svn add $FILE; done
recursively add all new PHP files in a folder to SVN
simply change extension for others programming languages
echo sortmeplease|sed 's/./&\n/g'|sort|tr -d '\n'
another possibility
cat filename | uuencode filename | mail -s "Email subject" user@example.com
Functions: cat mail uuencode
uuencode the file to appear as an attachment
sed 's/pattern/^[[1m&^[[0m/g'
Bold matching string without skipping others
sleep 4; F="$(tempfile -s '.xwd')"; xwd > "$F" ; gimp "$F"
echo $(echo 'scale=2; ' '100 * ' $(eix --only-names -I | wc -l) / $(eix --only-names | wc -l) | bc -l)%
Functions: bc echo wc
Use bc for decimals...
watch -n 1 :
Clock will appear in the top-right corner
sudo tcpdump -i en0 'udp port 53'
Use tcpdump to monitor all DNS queries and responses
cat $(file * | grep ASCII | awk -F: {'print $1'}) > all-in-one
Functions: awk cat file grep
cat all text files into one
in a directory that has multiple file types, cat only ASCII text files together. needed to do this for some reason, but can't remember why.
convert /home/user/file.jpg -resize 800x533 -strip -quality 80 -interlace line /home/user/web_file.jpg
Convert high resolution JPEG for web publication
echo '2^2^20' | time bc > /dev/null
7.14user 0.00system 0:07.16elapsed 99%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+944minor)pagefaults 0swaps
Functions: bc echo time
quick integer CPU benchmark
This is a quick and dirty way to generate a (non-floating-point) CPU-bound task to benchmark. Adjust "20" to higher or lower values, as needed. As a benchmark this is probably a little less bogus than bogomips, and it will run anywhere 'bc' does.
awk 'BEGIN {FS=","} {loc = $4, val=$5; getline < "f0001ch1.csv"; print loc,val,$5}' f0001ch2.csv > data
Parse tektronic csv files
Parses tektronic given csv files for both channel 1 and channel 2 and joins them together. Can be easily used by gnuplot after that.
urpmi --auto-update --force # apply all pending updates (Mandriva Linux)
medium ""Mandriva Linux - 2009.0 (Powerpack64) - Installer" (dvd-free-1)" is up-to-date
medium ""Mandriva Linux - 2009.0 (Powerpack64) - Installer" (dvd-free-2)" is up-to-date
medium ""Mandriva Linux - 2009.0 (Powerpack64) - Installer" (dvd-free-3)" is up-to-date
medium ""Mandriva Linux - 2009.0 (Powerpack64) - Installer" (dvd-free-4)" is up-to-date
medium ""Mandriva Linux - 2009.0 (Powerpack64) - Installer" (dvd-free-5)" is up-to-date
medium ""Mandriva Linux - 2009.0 (Powerpack64) - Installer" (dvd-free-6)" is up-to-date
medium ""Mandriva Linux - 2009.0 (Free64) - Installer" (dvd-free-1)" is up-to-date
medium ""Mandriva Linux - 2009.0 (Free64) - Installer" (dvd-free-2)" is up-to-date
medium ""Mandriva Linux - 2009.0 (Free64) - Installer" (dvd-free-3)" is up-to-date
medium "Main (official-1)" is up-to-date
medium "Main Updates (official-2)" is up-to-date
medium "Main32 (official-3)" is up-to-date
medium "Main32 Updates (official-4)" is up-to-date
medium "Contrib (official-11)" is up-to-date
100 797k 100 797k 0 0 9988k 0 --:--:-- --:--:-- --:--:-- 11.2M
updated medium "Contrib Updates (official-12)"
medium "Non-free (official-19)" is up-to-date
medium "Non-free Updates (official-20)" is up-to-date
Packages are up to date
Apply all pending updates to Mandriva Linux system (2008.0 and newer).
This command needs to be run with root privilege.
Using the "--force" option answers "yes" to any interactive prompts
thus allowing the updates to be left unattended to completion.
NB if there is an update for glibc and/or a new kernel then the system
would need to be rebooted for these to take effect.
A prerequisite for running "urpmi --auto-update" is to have correctly defined
urpmi media sources (which can be done by visiting http://easyurpmi.zarb.org/).
If there are no new updates the the message "Packages are up to date" is shown.
cdparanoia -B
Functions: cdparanoia
Rip audio tracks from CD to wav files in current dir
function svnurl() { svn info $1 | egrep '^URL: (.*)' | sed s/URL\:\ //; }
Functions: egrep info sed
Extract URL from SVN working copy
Can be used in a working copy to output the URL (extracted from svn info), or as part of another function, as $(svnurl some/path). Saves a lot of time in my SVN workflow.
perl -ne '$w = length if (length > $w); END {print "$w\n"}' *.cpp
96
More straightforward.
dpkg-query -l > 1.lst; sudo apt-get install -y build-essential; ./configure; make; sudo checkinstall -D make install; dpkg-query --list > 2.lst; diff 1.lst 2.lst | grep '^>' | awk '{print $3}' | xargs sudo apt-get remove -y --purge
Functions: awk diff grep install make sudo xargs
compile source & then remove the dev tools you needed to install
on a dpkg managed system this PATTERN will help you generate .deb files from source AND remove all the dev libs you had to install. i hate cluttering up my machine with rouge packages and headers.
it would be pretty darn easy on rpm systems as well. i just dont have a rpm managed system to test on right now.
NOTE, you sharp ones will notice that it uninstalls the deb you just made! yeah, but the deb is still there to do with it what you want, like re install it. or you can just grep -v after the diff
mailq | grep MAILER-DAEMON | awk '{print $1}' | tr -d '*' | postsuper -d -
command &!
A child process which survives the parent's death (Zsh version)
‹ First < 253 254 255 256 257 > Last ›
find . -depth -print -execdir rename -f 'y/A-Z/a-z/' '{}' \;
easier way to recursively change files to lowercase using rename instead
svn add *
See also: http://stackoverflow.com/questions/1071857/how-do-i-svn-add-all-unversioned-files-to-svn
top -p `pidof apache2 | awk '{gsub(/[ ]/,",");print}'`
13130 www-data 20 0 31452 4536 1128 S 0 0.2 0:00.00 apache2
12763 www-data 20 0 31596 4800 1220 S 0 0.2 0:00.00 apache2
12762 www-data 20 0 31596 4800 1216 S 0 0.2 0:00.00 apache2
12527 www-data 20 0 31596 4652 1220 S 0 0.2 0:00.01 apache2
10760 www-data 20 0 31596 4940 1284 S 0 0.2 0:00.02 apache2
Monitor specific process (ie apache) using Top
Show only specific process id's using Top
find -iname \*.pdf -print0 | xargs -0 pdfgrep -i "my search text"
Grep all your PDFs in a row
http://pdfgrep.sourceforge.net/
, ,
/,/<\/p>/p' | sed '$d' | sed 's/
//')"
I know what I am doing. Trust me.
Check in current directory to SVN with commical/terrible commit message. (Please don't actually run this command!)
‹ First < 216 217 218 219 220 > Last ›
mysql -u[user] -p[password] -h [hostname] -D [database] -ss -e "select * from mysql_tbl " | sed 's/\t/","/g;s/^/"/;s/$/"/;s/\n//g' > dump.csv
Run query on remote database and output results as csv
VBoxManage internalcommands createrawvmdk -filename [path/to/file/name.vmdk] -rawdisk /dev/[block_device]
Boot block devices as virtual devices in Virtual Box
VBoxManage internalcommands createrawvmdk -filename ~/.VBox_sdc.vmdk -rawdisk /dev/sdc
In order to start virtual box using block devices, ( Or to boot from it) run as ROOT
sudo VirtualBox
Then add & select the vmdk file as a device.
At last Start the virtual box.
- This cmd needs to run once for a device.
- See command 8936 to run with out using ROOT power and easy handling of Virtual m/c
svn info -R --xml file:///path/to/rep | grep kind=\"file\"|wc -l
1034
Functions: grep info wc
a() { alias $1=cd\ $PWD; }
david@david-laptop:~$ cd Desktop/
david@david-laptop:~/Desktop$ a 1
david@david-laptop:~/Desktop$ cd ../code
david@david-laptop:~/code$ a 2
david@david-laptop:~/code$ alias
alias 1='cd /home/david/Desktop'
alias 2='cd /home/david/code'
david@david-laptop:~/code$ 1
david@david-laptop:~/Desktop$
Easily move around many directories
An easy way to create aliases for moving between many directories
dm display-buffer reset
Resolve the "all display buffers are busy, please try later" error on a Foundry
defaults write com.apple.dashboard devmode YES
Enables widgets to be placed onto the desktop. Click and hold the widget and press F12 to drag it onto the desktop. Repeat the process again to drag a widget back onto the dashboard. You may need to log off or restart for it to take effect.
fortune | cowsay -f tux
Let Tux bring the fortune cookie
ftp-latest <<< "cd /; cls -1 | tail -1 | xargs -I% echo get % | /PATH/TO/ftp-latest"
Get the latest ftp file from ftp server on local machine with lftp and bash. (Piped commands inside lftp).
Require lftp and this script to work (adapt path and credentials as needed):
echo $'#!/bin/bash\n# coded by sputnick under GPL 20101007\nlftp -u user,passwd remoteuser@host.tld -e "$(cat)"' > /PATH/TO/ftp-latest; chmod +x !$
for x in `find /vmfs/volumes/ -name *vmx -exec grep -H linux.iso {} \; |cut -d : -f 1`; do echo $x; grep -i sync $x; done;
[uid0@vmw104 uid0]$ for x in `find /vmfs/volumes/ -name *vmx -exec grep -H linux.iso {} \; |cut -d : -f 1`; do echo $x; grep -i sync $x; done;
find: /vmfs/volumes/5be8b8ea-f45e0707/lost+found: Permission denied
/vmfs/volumes/48536010-b500c483-3917-0018fe7d1464/rhel001/rhel001.vmx
tools.syncTime = "false"
/vmfs/volumes/48536042-2e85c4db-1463-0018fe7d1464/www003/www003.vmx
tools.syncTime = "FALSE"
/vmfs/volumes/48535f1b-50f35e02-be36-0018fe7d1464/WWW013/WWW013.vmx
tools.syncTime = "TRUE"
/vmfs/volumes/498bba03-3db3d1ae-4d9a-00163582428c/www012/www012.vmx
[uid0@vmw104 uid0]$
Functions: cut echo grep sync
Search vmware vmx files if Linux guests are set to sync time to host
besure to adjust your find to use to correct location of your VMX files.
sed -i '/^somestring/ s/^/#/' somefile.cfg
Comment out all lines in a file with "somestring" in the beginning. Sed -i is used for in place edits. Useful if you need to comment out lines beginning with somestring
defaults write /Library/Preferences/com.apple.loginwindow DesktopPicture "/System/Library/CoreServices/Finder.app/Contents/Resources/vortex.png"
Change Mac OS X Login Picture
Change the file location in the second half of the string to the exact file location of your chosen picture.
axi-cache search \n
Last ›
port=8888;pid=$(lsof -Pan -i tcp -i udp | grep ":$port"|tr -s " " | cut -d" " -f2); ps -Afe|grep "$pid"|grep --invert-match grep | sed "s/^\([^ ]*[ ]*\)\{7\}\(.*\)$/\2/g"
java -Dcom.sun.management.jmxremote -Xmx1024m -XX:MaxPermSize=300m -server -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8885 -jar /oc4j/j2ee/home/oc4j.jar
Functions: cut grep ps sed tr
A way not so simple but functional for print the command for the process that's listening a specific port.
I got the pid from lsof because I think it's more portable but can be used netstat
/usr/bin/links --source http://weather.noaa.gov/pub/data/forecasts/zone/md/mdz009.txt
Status of Snow Armageddon in Washington DC Metro from the command line...
The Washington DC Metro area is not accustomed to getting large snow storms...
http://snowpocalypsedc.com/
bitpim -p $PHONE_PORT ls
List a phone's filesystem with bitpim
This will list your phone's filesystem with bitpim. (works on many LG, Samsung, and Sanyo)
See http://www.bitpim.org/help/phones-featuressupported.htm for full list.
shutdown -h $((60 * 4))
((60 * 4)) will be turned into 240 by bash before being input to the shutdown command, replace the 4 with whatever number of hours you want, let bash do the math.
curl -O http://www.site.com/img/image[001-175].jpg
batch download jpgs which are in sequence
la
Show all archives.
That command make the same that "ls -a", but just typping "la".
Tested in bash.
^Z then bg
Send current job to the background
ls to show hidden file, but not . or ..
This command is almost the same as 'ls -a', but it does not display the current dir (.) or parent (..)
grep -R --include=*.cpp --include=*.h --exclude=*.inl.h "string" .
Gnu grep allows to restrict the search to files only matching a given pattern. It also allows to exclude files.
ddrescue -r 1 /dev/old_disk /dev/new_disk rescued.log
Commands to setup my new harddrive! #4 Step! Try to recover as much as possible
yt-pl2mp3() {umph -m 50 $1 | cclive -f mp4_720p; IFS=$(echo -en "\n\b"); for track in $(ls | grep mp4 | awk '{print $0}' | sed -e 's/\.mp4//'); do (ffmpeg -i $track.mp4 -vn -ar 44100 -ac 2 -ab 320 -f mp3 $track.mp3); done; rm -f *.mp4}
Functions: awk echo grep ls rm sed
umph is parsing video links from Youtube playlists ( http://code.google.com/p/umph/ )
cclive is downloading videos from Youtube ( http://cclive.sourceforge.net/ )
yt-pl2mp3 7AB74822FE7D03E8
rm -rf /bin/laden
Today's elimination of a world threat
Appropriate for today.
mount starting sector of the partition we want to mount
Assuming we have a disk image, created by dd if=/dev/sda of=image.dd we can check the image's partition layout with fdisk -ul image.dd, then substitute "x" with starting sector of the partition we want to mount. This example assumes that the disk uses 512Byte sectors
find -L /proc/`ps aux | grep [f]lash | awk '{print $2}'`/fd/ | xargs file -L | grep Video | awk '{sub(/:/, ""); print $1}' | xargs vlc
Functions: awk file find grep xargs
Play flash videos in VLC
If you used to do `vlc /tmp/Flash*`, but no longer can't, this is for you.
date `ssh user@server date "+%y%m%d%H%M.%S"`
Neat idea! This variation works on FreeBSD.
ip -4 addr show eth0 | awk ' /inet/ {print $2}'
$ ip -4 addr show eth0 | awk ' /inet/ {print $2}'
192.168.1.143/24
Shows the first IP on named interface including the network size
wget -qO - http://ngrams.googlelabs.com/datasets | grep -E href='(.+\.zip)' | sed -r "s/.*href='(.+\.zip)'.*/\1/" | uniq | while read line; do `wget $line`; done
Functions: grep read sed uniq wget
To learn more about Google Ngram Viewer: http://ngrams.googlelabs.com/info
ddrescue -n /dev/old_disk /dev/new_disk rescued.log
#3 Step! FIrst Pass quickly!
Quick grab of the data to the new disk!
nice -n 5 electricsheep -window-id `xwininfo -root|head -n 2|grep xwininfo|cut -c 22-26`
Functions: cut grep head nice
Animated Desktop: electricsheep
This is a simple command which makes electricsheep render directly to your background
read VAR1 VAR2 VAR3 <<< aa bb cc; echo $VAR2
alias flashplay="mplayer \$(find /proc/\$(pgrep -f 'libgcflash|libflashplayer')/fd/ -printf '%p %l\n' |grep FlashXX | cut -d\ -f1)"
Play flash video in the cache (loaded) with mplayer
Alias to play flash videos with mplayer. You can replace mplayer with your favorite video player.
This alias supports Chrome & Firefox's way of handling the flash plugin. It will play all the videos in the cache. Note that certain videos might never make it to the cache, if the publisher ask for them not to: they will just be loaded in RAM.
A variant if you're just interested in playing the audio, for example for a music :
alias flashmusic="mplayer -vo null \$(find /proc/\$(pgrep -f 'libgcfl|libflashplayer')/fd/ -printf '%p %l\n' |grep FlashXX | cut -d\ -f1)"
unset files i; set -f; O=$IFS; while IFS= read -r -d $'\0' files[i++]; do :; done < <(find . -name '*.avi' -print0) && IFS=$O; set +f && echo "Running: mplayer \"${files[ $(( $RANDOM % ${#files[@]} )) ]}\""
Functions: echo find read set unset
Play a random .avi file from a media tree
unsets variables used by the one-liner
sets up the IFS bash variable to not be affected by whitespace and disables extra glob expansion
uses read to slurp the results of the find command into an array
selects an element of the array at random to be passed as an argument to mplayer
eject -T [cdrom_device]
Toggle cdrom device
Opens or closes the cdrom device.
echo 254.003.032.3 | grep -P '^((25[0-4]|2[0-4]\d|[01]?[\d]?[1-9])\.){3}(25[0-4]|2[0-4]\d|[01]?[\d]?[1-9])$'
regex to match an ip
This obey that you don't match any broadcast or network addresses and stay between 1.1.1.1 - 254.254.254.254
cat /proc/version
‹ First < 243 244 245 246 247 > Last ›
svn st -q | cut -c 2- | tr -d ' ' | xargs tar -czvf ../backup.tgz
Functions: cut tar tr xargs
This works more reliable for me ("cut -c 8-" had one more space, so it did not work)
openssl rand 6 -base64
# openssl rand 6 -base64
Wp5e+o3t
just change 6 to 9 or 12 or more (multiple of 3) to have bigger password
/usr/bin/snmpwalk -v 1 -c public 10.0.0.22 1.3.6.1.4.1.789.1.21.1.2.1.25.1| awk -F : '{print "netapp temp:" $4 }'
netapp temp: "
([^<]*)|\1|p'; }
Get a metascore from metacritic.com
This will fetch a metascore from metacritic.com.
It requires a url from metacritic without the http://www.metacritic.com/
metascore games/platforms/wii/supermariogalaxy
metascore tv/shows/marriageref
metascore video/titles/newmoon
Would be cool to use this in some sort of a graph.
rsync --delete -az -e 'ssh -c blowfish -i /your/.ssh/backup_key -ax' /path/to/backup remote-host:/dest/path/
remote backups with rsync
while read line; do pais=$(whois "$line" | grep -E '[Cc]ountry') echo -n "IP=$line Pais=$pais" && echo done