grep a large list against a large file

by

Try

grep -f the_ids.txt huge.csv

Additionally, since your patterns seem to be fixed strings, supplying the -F option might speed up grep.

   -F, --fixed-strings
          Interpret PATTERN as a  list  of  fixed  strings,  separated  by
          newlines,  any  of  which is to be matched.  (-F is specified by
          POSIX.)

Related Contents:

  1. Using grep and sed to find and replace a string
  2. List file names based on a filename pattern and file content?
  3. How to grep exact literal string (no regex)
  4. GROUP BY/SUM from shell
  5. How can I set the grep after context to be “until the next blank line”?
  6. Given two directory trees, how can I find out which files differ by content? [closed]
  7. How to ‘grep’ a continuous stream?
  8. How to run a shell script on a Unix console or Mac terminal?
  9. What is the difference between “#!/usr/bin/env bash” and “#!/usr/bin/bash”?
  10. Aborting a shell script if any command returns a non-zero value
  11. Linux: copy and create destination dir if it does not exist
  12. How can I assign a name for a screen? [closed]
  13. How can I format my grep output to show line numbers at the end of the line, and also the hit count?
  14. grep without showing path/file:line
  15. How to grep a string in a directory and all its subdirectories? [duplicate]
  16. Command to change the default home directory of a user [closed]
  17. How to concatenate multiple lines of output to one line?
  18. Add up a column of numbers at the Unix shell
  19. How to send data to local clipboard from a remote SSH session
  20. How do I use grep to search the current directory for all files having the a string “hello” yet display only .h and .cc files?
  21. Get exit code of a background process
  22. Save modifications in place with awk
  23. How to print third column to last column?
  24. Get specific line from text file using just shell script
  25. Forcing bash to expand variables in a string loaded from a file
  26. Linux/Unix command to determine if process is running?
  27. Use find command but exclude files in two directories
  28. Insert multiple lines into a file after specified pattern using shell script
  29. How to find file accessed/created just few minutes ago
  30. What does ‘set -e’ do, and why might it be considered dangerous?
  31. Can I call pushd/popd and prevent it printing the stack?
  32. Make ls print it all on one line (like in terminal)
  33. How can I list the files in a zip archive without decompressing it?
  34. Recursively cat all the files into single file
  35. How to read a .properties file which contains keys that have a period character using Shell script
  36. Create a dedicated folder for every zip files in a directory and extract zip files
  37. Randomly Pick Lines From a File Without Slurping It With Unix
  38. Using Bash Script to Find Line Number of String in File
  39. Pass parameter to an awk script file
  40. How to list specific type of files in recursive directories in shell?
  41. How can I get awk to print without white space?
  42. How to sort the output of “grep -l” chronologically by newest modification date last?
  43. Replace spaces with underscores via BASH
  44. Reverse sort order of a multicolumn file in BASH
  45. Batch renaming files in command line and Xargs
  46. How can I trim white space from a variable in awk?
  47. Check if a condition is false
  48. cat file with no line wrap
  49. How to use grep efficiently?
  50. Unix command to escape spaces

Leave a Comment