File management
Finding or searching through files and folders
Search for a string
A case-sensitive search through all of the files from current folder and below.
$ find . | xargs grep -s "mystring" | more
A case-insensitive search through all of the files from current folder and below.
$ find . | xargs grep -si "mystring" | more
A case-insensitive search through all of the files from current folder and below, and truncate long search results.
$ find . | xargs grep -sioE ".{0,20}mystring.{0,20}" | more
An alternative way to search for keywords.
$ cat file.txt | grep word
$ grep -r -e word /etc"
- Last tested on Ubuntu 14.04.2 LTS (trusty)
$ cp -r folder1/. target/
Delete files
Delete files recursively
- Lasted tested on Ubuntu 16.04.2 LTS (xenial)
$ find . -type f -name "*.mp4" -exec rm {} \;
Fastest way to delete a folder
- Last tested on RHEL 8.3 (2021-03-09)
$ mkdir empty
$ rsync -a --delete empty/ foldername
Another method of deleting files under a folder
$ ls -f1 | xargs rm
Setting a default group for a folder
- Last tested on Ubuntu 16.04 LTS (xenial)
This is to set permission for an existing folder for collaboration. This assumes the group name to be dev, and the folder to be /srv/www/project.
This sets setgid bit on the folder.
$ sudo find /srv/www/project -type d -exec chgrp dev {} +
$ sudo find /srv/www/project -type d -exec chmod g+s {} +
Make it writable by the group.
$ sudo chmod -R g+w /srv/www/project
Change group ownership of existing files.
$ sudo chown -R mhan:dev /srv/www/project
These commands should be executed for a new folder.
$ sudo chgrp dev /srv/www/project
$ sudo chmod g+s /srv/www/project
Unpacking gz files
The files are compressed using Lempel-Ziv (LZ77) algorithm. GNU zip (gzip/gunzip) is used for this.
$ gunzip file.gz
or
$ gzip -d file.gz
Zip a folder
$ zip -r test.zip ./test
Mirror a folder
- Last tested on CentOS 8 (2020-06-08)
Copy ALL and keep EVERYTHING same without deleting the source, but deleting files on the target folder that are not found in the source.
$ rsync --delete -HAXavr /source/folder/foldername/ /target/folder/foldername/
- Last tested on Ubuntu 16.04 LTS (xenial)
This also works between servers. The first one is on the same server.
Explanation of parameters used:
- -a: archive - preserve permissions, ownership, and timestamps
- -v: verbose
- -z: compress
$ rsync -azv /folder_a/ /folder_b/
This one is between different servers.
$ rsync -azv ~/folder_a/ mhan@tom.myserver.com:~/folder_b/
Move files
$ rsync --remove-source-files -HAXzvhr /source/chanbara/* ./chanbara/
Move files older or less than x days
- Last tested on Ubuntu 14.04.5 LTS (trusty)
Make a list of files to copy. Example here is a list of files older than 365 days.
$ find . -type f -mtime +365 > /tmp/rsyncfiles
This is a list of files younger than 365 days
$ find . -type f -mtime -365 > /tmp/rsyncfiles
rsync across the network to another server. This command deletes the source files after they are moved.
$ rsync --remove-source-files -zvh --files-from=/tmp/rsyncfiles . mhan@zinc.wherever.com:/target/folder/