PHP中检查特定文本的大量远程文件的最快表现方式是什么？

Question

I want to check a list of ~300k webpages if they contain a certain text (e.g. "not available"). This should be done every day.

What would be the best way to do this in PHP?

I can use fread&fopen to read the page line by line, and if a line contains the text, go to the next url.

An other option is to use cURL, which is suppose to be faster than fread, but I'm not sure if it is possible to open a stream and read the page line by line, or that I have to download the whole file and then check it for the text.

Are there other (better) options?

What will perform best on speed?

Answer 1

I have a script that does the similar thing as you mentioned, i found fread more reliable and faster than curl process, especially if the page has media in it. I would recommend fread.