dsiv4041 2017-08-14 08:40
浏览 52

PHP中的大型文件外部排序

I know similar questions have been asked but they don't address the finer details and not in PHP...

I have a .txt file with a comma separated list of numbers.It's simple enough to sort the file, split it and save into multiple smaller files. What would be an memory efficient way to put small chunks of these files back together and sort them?

All my current attempts to do this have resulted in huge memory utilisation.

A more specific way to put it could be:

  1. how do I stream small pieces of data from a file
  2. track which pieces of data I've already processed
  3. Create a buffer, and when the buffer is full write it out
  4. start back at 1 and repeat until all the data has been sorted
  • 写回答

0条回答 默认 最新

    报告相同问题?

    悬赏问题

    • ¥15 基于卷积神经网络的声纹识别
    • ¥15 Python中的request,如何使用ssr节点,通过代理requests网页。本人在泰国,需要用大陆ip才能玩网页游戏,合法合规。
    • ¥100 为什么这个恒流源电路不能恒流?
    • ¥15 有偿求跨组件数据流路径图
    • ¥15 写一个方法checkPerson,入参实体类Person,出参布尔值
    • ¥15 我想咨询一下路面纹理三维点云数据处理的一些问题,上传的坐标文件里是怎么对无序点进行编号的,以及xy坐标在处理的时候是进行整体模型分片处理的吗
    • ¥15 CSAPPattacklab
    • ¥15 一直显示正在等待HID—ISP
    • ¥15 Python turtle 画图
    • ¥15 stm32开发clion时遇到的编译问题