What’s the difference between UTF-8 and UTF-8 without BOM?

by

The UTF-8 BOM is a sequence of bytes at the start of a text stream (0xEF, 0xBB, 0xBF) that allows the reader to more reliably guess a file as being encoded in UTF-8.

Normally, the BOM is used to signal the endianness of an encoding, but since endianness is irrelevant to UTF-8, the BOM is unnecessary.

According to the Unicode standard, the BOM for UTF-8 files is not recommended:

2.6 Encoding Schemes

… Use of a BOM is neither required nor recommended for UTF-8, but may be encountered in contexts where UTF-8 data is converted from other encoding forms that use a BOM or where the BOM is used as a UTF-8 signature. See the “Byte Order Mark” subsection in Section 16.8, Specials, for more information.

Related Contents:

  1. What’s the difference between UTF-8 and UTF-8 with BOM?
  2. What is the difference between UTF-8 and Unicode?
  3. How does UTF-8 “variable-width encoding” work?
  4. What is the proper way to URL encode Unicode characters?
  5. FPDF utf-8 encoding (HOW-TO)
  6. ASCII vs Unicode + UTF-8
  7. UTF-8, UTF-16, and UTF-32
  8. What are Unicode, UTF-8, and UTF-16?
  9. Unicode, UTF, ASCII, ANSI format differences
  10. What’s the difference between Unicode and UTF-8? [duplicate]
  11. Write to UTF-8 file in Python
  12. Convert Unicode to ASCII without errors in Python
  13. How do I remove  from the beginning of a file?
  14. Using awk to remove the Byte-order mark
  15. Trouble with UTF-8 characters; what I see is not what I stored
  16. Really Good, Bad UTF-8 example test data [closed]
  17. How many characters can be mapped with Unicode?
  18. C programming: How to program for Unicode?
  19. UTF8 to/from wide char conversion in STL
  20. Why is this LSEP symbol showing up on Chrome and not Firefox or Edge?
  21. What is the range of Unicode Printable Characters?
  22. UTF-8 & Unicode, what’s with 0xC0 and 0x80?
  23. Manually converting unicode codepoints into UTF-8 and UTF-16
  24. Do UTF-8, UTF-16, and UTF-32 differ in the number of characters they can store?
  25. How to read text files with ANSI encoding and non-English letters?
  26. What is this INSANE space character??? (google chrome)
  27. What’s the ASCII character code for ‘—’?
  28. What’s the difference between utf8_general_ci and utf8_unicode_ci?
  29. Why does modern Perl avoid UTF-8 by default?
  30. Using PowerShell to write a file in UTF-8 without the BOM
  31. How do you echo a 4-digit Unicode character in Bash?
  32. Do I really need to encode ‘&’ as ‘&’?
  33. How can I transform string to UTF-8 in C#?
  34. How many characters can UTF-8 encode?
  35. What are the most common non-BMP Unicode characters in actual use? [closed]
  36. What’s the complete range for Chinese characters in Unicode?
  37. UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xef in position 1
  38. Convert UTF-8 with BOM to UTF-8 with no BOM in Python
  39. What’s up with these Unicode combining characters and how can we filter them?
  40. SSIS Convert Between Unicode and Non-Unicode Error
  41. How do I convert between ISO-8859-1 and UTF-8 in Java?
  42. Fixing broken UTF-8 encoding
  43. Adding UTF-8 BOM to string/Blob
  44. Ruby 1.9: how can I properly upcase & downcase multibyte strings?
  45. What do I need to know about Unicode? [closed]
  46. What is unicode character 2028 (LS / Line Separator) used for?
  47. Force strings to UTF-8 from any encoding
  48. hash unicode string in python
  49. utf8mb4_unicode_ci vs utf8mb4_bin
  50. Unicode symbol that represents “download” [closed]

Leave a Comment