grep sed awk 过滤相同内容
grep
[root@yuyingqian ~]# grep 'oldb.y' oldboy.txt I am oldboy teacher! my blog is http://oldboy.blog.51cto.com our size is http://blog.oldboyedu.com my god ,i am not oldbey,but OLDBOY!sed
[root@yuyingqian ~]# sed -n '/oldb.y/p' oldboy.txt I am oldboy teacher! my blog is http://oldboy.blog.51cto.com our size is http://blog.oldboyedu.com my god ,i am not oldbey,but OLDBOY!awk
[root@yuyingqian ~]# awk '/oldb.y/' oldboy.txt I am oldboy teacher! my blog is http://oldboy.blog.51cto.com our size is http://blog.oldboyedu.com my god ,i am not oldbey,but OLDBOY!
awk按列过滤
[root@yuyingqian ~]# cat /server/files/reg.txt Zhang Dandan 41117397 :250:100:175 Zhang Xiaoyu 390320151 :155:90:201 Meng Feixue 80042789 :250:60:50 Wu Waiwai 70271111 :250:80:75 Liu Bingbing 41117483 :250:100:175 Wang Xiaoai 3515064655 :50:95:135 Zi Gege 1986787350 :250:168:200 Li Youjiu 918391635 :175:75:300 Lao Nanhai 918391635 :250:100:175
过滤出第二列以X开头的行
[root@yuyingqian ~]# awk '$2~/^X/' /server/files/reg.txt Zhang Xiaoyu 390320151 :155:90:201 Wang Xiaoai 3515064655 :50:95:135
过滤出第三列以5结尾的行
[root@yuyingqian ~]# awk '$3~/5$/' /server/files/reg.txt Wang Xiaoai 3515064655 :50:95:135 Li Youjiu 918391635 :175:75:300 Lao Nanhai 918391635 :250:100:175
过滤出第三列以5结尾的行 显示第三列跟第四列
[root@yuyingqian ~]# awk '$3~/5$/{print $3,$4}' /server/files/reg.txt 3515064655 :50:95:135 918391635 :175:75:300 918391635 :250:100:175
姓氏是Zhang的人，显示他的第二次捐款金额及她的名字
[root@yuyingqian ~]# awk -F"[ :]+" '$1~/Zhang/{print $1,$2,$5}' /server/files/reg.txt Zhang Dandan 100 Zhang Xiaoyu 90
显示所有ID号码最后一位数字是1或5的人的全名
[root@yuyingqian ~]# awk '$3~/[15]$/' /server/files/reg.txt Zhang Xiaoyu 390320151 :155:90:201 Wu Waiwai 70271111 :250:80:75 Wang Xiaoai 3515064655 :50:95:135 Li Youjiu 918391635 :175:75:300 Lao Nanhai 918391635 :250:100:175
显示所有人的全名，以姓,名的格式显示，如Meng,Feixue
[root@yuyingqian ~]# awk '{print $1","$2}' /server/files/reg.txt Zhang,Dandan Zhang,Xiaoyu Meng,Feixue Wu,Waiwai Liu,Bingbing Wang,Xiaoai Zi,Gege Li,Youjiu Lao,Nanhai
显示Xiaoyu的捐款.每个值时都有以$开头.如$520$200$135
[root@yuyingqian ~]# awk '{gsub(/:/,"$");print $4}' /server/files/reg.txt $250$100$175 $155$90$201 $250$60$50 $250$80$75 $250$100$175 $50$95$135 $250$168$200 $175$75$300 $250$100$175
换/oldboy/passwd.txt文件的第一列和最后一列(不用修改文件内容)
[root@yuyingqian ~]# cat /oldboy/passwd.txt root:x:0:0:root:/root:/bin/bash bin:x:1:1:bin:/bin:/sbin/nologin [root@yuyingqian ~]# sed -r 's#(.*)(:x.*:)(.*)#\3\2\1#g' /oldboy/passwd.txt /bin/bash:x:0:0:root:/root:root /sbin/nologin:x:1:1:bin:/bin:binawk调换
[root@yuyingqian ~]# awk -F: '{tmp=$1;$1=$NF;$NF=tmp;print $0 }' /oldboy/passwd.txt /bin/bash x 0 0 root /root root /sbin/nologin x 1 1 bin /bin binawk调换
awk显示时以什么分割 OFS (awk的内置变量) -v修改
[root@yuyingqian ~]# awk -F: -vOFS=":" '{tmp=$1;$1=$NF;$NF=tmp;print $0 }' /oldboy/passwd.txt /bin/bash:x:0:0:root:/root:root /sbin/nologin:x:1:1:bin:/bin:bin
BEGIN{}里面的内容会在awk读取文件之前运行
[root@yuyingqian ~]# awk -F: 'BEGIN{print "name"}{print $1}' /oldboy/passwd.txt name root bin运行测试
[root@yuyingqian ~]# awk 'BEGIN{print 1/5,1*5,1+5,1-5}' 0.2 5 6 -4
统计文件中空行的数量
[root@yuyingqian ~]# cat /oldboy/oldboy.txt oldboy dsadsa d sadsa sa dsad dsadasd [root@yuyingqian ~]# awk '/^$/{i=i+1;print i}' /oldboy/oldboy.txt 1 2 3 4 5
awk计算公式:i=i+1/i++ (i从0开始)
进行计数 计算一共出现了多少次
END{}里面的内容会在awk读取文件之后运行
[root@yuyingqian ~]# awk '/^$/{i=i+1;print i}' /oldboy/oldboy.txt 1 2 3 4 5 [root@yuyingqian ~]# awk '/^$/{i=i+1}END{print i}' /oldboy/oldboy.txt 5
统计access.log中 第九列是200的数量
[root@yuyingqian ~]# awk '$9==200{i++}END{print i}' access.log 142666 [root@yuyingqian ~]# awk '$9~/^200$/{i++}END{print i}' access.log 142666
i+i+$1数字(求和/累加) i从0开始 $依次+1
[root@yuyingqian ~]# seq 100 |awk '{i=i+$1}END{print i}' 5050
