dongqingchan2385 2014-07-21 09:29
浏览 25

导入大型MySQL表时PHP脚本重新启动

This is a problem I'm having for quite some time now. I work for a banking institute: our service provider lets us access our data via ODBC through a proprietary DB engine. Since I need almost a hundred tables for our internal procedures and whatnot, I set up some "replication" scripts, put em in a cron and basically reloading from scratch the tables I need every morning.

When the number of records is small (approx. 50.000 records and 100 columns or so) everything goes smooth, but whenever I get a medium-big table (approx. 700.000 records), more often than not the script restarts itself (I look at my MySQL tables while the import scripts are running and I see them going 400k, 500k... and back from 1).

This is an example of one of my import scripts:

   <?php

   ini_set('max_execution_time', '0');
   $connect = odbc_connect('XXXXX', '', '') or die ('0');

   $empty_query = "TRUNCATE TABLE SADAS.".$NOME_SCRIPT;
   $SQL->query($empty_query);

   $select_query = "   SELECT...
                       FROM ...";

   $result = odbc_exec($connect, $select_query);
   while($dati = odbc_fetch_object($result)) {

    $insert_query = "   INSERT INTO ...
                        VALUES ...";

    $SQL->Query($insert_query);

   }

   // Close ODBC
   odbc_close($connect);

   ?>

Any ideas?

  • 写回答

0条回答 默认 最新

    报告相同问题?

    悬赏问题

    • ¥20 我想使用一些网络协议或者部分协议也行,主要想实现类似于traceroute的一定步长内的路由拓扑功能
    • ¥30 深度学习,前后端连接
    • ¥15 孟德尔随机化结果不一致
    • ¥15 apm2.8飞控罗盘bad health,加速度计校准失败
    • ¥15 求解O-S方程的特征值问题给出边界层布拉休斯平行流的中性曲线
    • ¥15 谁有desed数据集呀
    • ¥20 手写数字识别运行c仿真时,程序报错错误代码sim211-100
    • ¥15 关于#hadoop#的问题
    • ¥15 (标签-Python|关键词-socket)
    • ¥15 keil里为什么main.c定义的函数在it.c调用不了