I was wondering if somebody could give me some advice. At the moment we are building a application that uses a lot of API's, such as Flickr, Facebook, Salesforge, Picasa, Twitter, LinkedIn etc. Now I was wondering what would eb the best idea to tackle the problem of data usage. First of all, requesting all that data eats away at your data capacities. Also the application should eb able to handle 1000's of users at the same time so using all those requests might get us flagged as DDOS attackers :P So my solution would be to store everything locally in MySQL, and update critical data every hour and other data once a day. How would you guys tackle this problem? One other problem is images, we will be using 1000000's of pictures. Would you guys recommend hosting those locally and updating them every so often, or just store links and send those to users? One final problem I am having, is how does MySQL perform with 1000's of users making hundreds of request every second, from complex tables. For example if a user loads a album, the database has to spit out 100 photos. Imagine that being done for 100 of users at the same time. Is mysql able to handle that all?
Thanks in advance, Sam