Homework assignment 1 – Unix Basics

This assignment will ask you to practice some of the UNIX basics we have covered. Some of the questions will ask you to use the practiceFiles; others will ask you to use the CELEX database (celex.txt). The assignment is due Sep. 4, at 5 p.m.

TIP: For dealing with tab-delimited text files, specify the delimiter as: $’\t’

1. Create a directory named ling5200 in your home directory to store all of the files for this course (3 points)
2. Download the practiceFiles.zip file and unzip it into the newly created ling5200 folder. Change directories to the practiceFiles directory using the absolute path, and show that you got there using the pwd command. (4 points)
3. Copy the devilsDictionary.txt file to devilsDictionary.copy (4 points)
4. Print out the first 20 filex in the practiceFiles directory, sorted in reverse alphabetical order (5 points)
5. Print out the number of entries in the celex.txt file (5 points)
6. Print out 20 random entries in the celex.txt file. Hint: look at the documentation for sort. (8 points)
7. Print out the last 20 lines of the celex.txt file (5 points)
8. Print the 50 most frequent words in celex.txt. Print only the orthography and the frequency. Save the results to a file called celex-most-frequent.txt. Hint: You will need sort, plus 2 pipes (9 points)
9. Now Print the 50 least frequent words in celex.txt. Print only the orthography and the frequency. Save the results to a file called celex-least-frequent.txt. Hint: You will need sort, plus 2 pipes (5 points)
10. Now combine the 2 files you just created and store the combination in a new file called celex-most-least-frequent.txt, with the most frequent words first, and the least frequent words last (6 points)
11. Print out the 20 most common word frequencies. Hint: The most common word frequency is 0. There are 34037 words in celex.txt with frequencies of 0 (6 points)