许多用户同时呼叫远程网址（实时）

Question

What is the best way (in PHP) to get the page title and metatag contents of potentially millions of remote URLs in realtime?

also, is this feasible to accomplish using a single shared server?

So far I'm looking into 4 possibilities. (I'm also using Codeigniter)

fOpen, get_meta_tags, file_get_contents, cURL

Answer 1

You can't do millions in real time on a shared server. You'll very likely get shutdown for using too much CPU. But if you are using PHP, your best bet would be to use multi-curl. See a very similar question, which contains code sample:

Status checker for hundreds IP addresses