soilblack2012 于 2013.11.16 17:50 提问
- python BeautifulSoup模块解码
soup = BeautifulSoup(html.read().decode('utf-8','ignore'), "html")
WARNING:root:Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER.
In rare cases (usually when a UTF-8 document contains text written in a completely different encoding), the only way to get Unicode may be to replace some characters with the special Unicode character “REPLACEMENT CHARACTER” (U+FFFD, �). If Unicode, Dammit needs to do this, it will set the .contains_replacement_characters attribute to True on the UnicodeDammit or BeautifulSoup object. This lets you know that the Unicode representation is not an exact representation of the original–some data was lost. If a document contains �, but .contains_replacement_characters is False, you’ll know that the � was there originally (as it is in this paragraph) and doesn’t stand in for missing data.
- mengzhendream 2016.10.23 15:29