I am using supervisord within a docker container(s) to run multiple instances of a php script. The purpose of the script is it scrapes data from a webpage. I have the number of processes in the config file set to 75 and it loads all of these fine. However when i run "top" or "htop" its only showing between 15-25 give or take are running. I can see on "top" a list of them all, and can confirm they are starting but some have R and other have S which changes as i monitor them.
Have tried reducing the instances to a single php script running, and scale the number of containers in docker from 1 to 75.
[program:collector]
priority = 100
numprocs=75
process_name = %(program_name)s_%(process_num)02d
command = /bin/bash -c "/bin/sleep 2 && /usr/bin/php collector.php"
directory=/var/www/dev
environment=GEARMAN_USER=gearman
redirect_stderr = true
stdout_logfile=/var/log/supervisor/program_phpworker.log
stderr_logfile=/var/log/supervisor/program_phpworker.error
startsecs = 5
autorestart = true
My expectations would be if i request 75 instances of the same script to run i would see all 75 running.