I deployed my site to Google App Engine (using Golang and datastore with 1000 records). billing is enabled and a daily budget established. The Quota Details page indicates everything is under quota. I am doing an Urlfetch to obtain a tsv file that I use to build data entities in the datastore.
Two problems:
- Only 778 entities are create - log indicates it is a long running process but it appears to terminate prematurely without error message. Docs say this is normal
- The second step involves creating a json file from the entities in the datastore. This process causes a "Panic: overquota" because the process is taking too long I suppose.
How do I proceed? Should I divide the tsv datafile into several smaller files? Can I request "more time" so I don't go over the safety quotas?
Important to note is that the datastore part of the developers console is showing some problems: Although my application has access to 778 datastore entities, the console only reports 484 entities of that kind with a total of only 704 entities of all kinds (actually are 933)
I've been working at this for a while and am wondering if there is something going on with the system or are there things I can do to get my data entities set up properly. I also wish I could find more to read about safety quotas... ... and get the remote api working! thanks!