| # |
Oct 2nd 2016, 16:31 |
michaelze |
lorb: just an example |
| # |
Oct 2nd 2016, 16:31 |
lorb |
I have turned of validation, and looking for pointers where else cake may require this much memory |
| # |
Oct 2nd 2016, 16:31 |
michaelze |
lorb: well yeah, obviously. what I mean by this is which part of it... Is it generating a lot of caches of some sort that don't get cleaned up? |
| # |
Oct 2nd 2016, 16:30 |
lorb |
well, cakephp is. obviously. running the data directly to mysql gets it done with no trouble |
| # |
Oct 2nd 2016, 16:29 |
michaelze |
lorb: okay, that sounds like something else is taking up the majority :) |
| # |
Oct 2nd 2016, 16:29 |
michaelze |
lorb: I would guess handling a lot of data is not a common task for a orm... |
| # |
Oct 2nd 2016, 16:28 |
lorb |
the records are just a few numbers. the whole data is read from a csv file that has just 3MB |
| # |
Oct 2nd 2016, 16:27 |
michaelze |
lorb: have you analyzed what actually takes up all the space? I mean how big is one of your "row" arrays, what else is there sitting around taking up space? |
| # |
Oct 2nd 2016, 16:25 |
lorb |
yes, I'm rewriting the code atm to do that, but I don't see why that has to be necessary. 100k is not that much data |
| # |
Oct 2nd 2016, 16:25 |
michaelze |
lorb: what about splitting the save operation up into junks? |
| # |
Oct 2nd 2016, 16:24 |
lorb |
I'm using saveAssociated() but yeah, I do have an array with 100k records |
| # |
Oct 2nd 2016, 16:24 |
michaelze |
lorb: can you tell a little bit more about what you are doing? is it some sort of import? |
| # |
Oct 2nd 2016, 16:24 |
lorb |
similaar |
| # |
Oct 2nd 2016, 16:23 |
michaelze |
lorb: do you actually create an array with 100k "rows" and then use saveAll to store them? |
| # |
Oct 2nd 2016, 16:22 |
lorb |
for some reason cakephp has a fatal error of memory exhaustion when trying to save 100k rows, which shouldn't be a problem with 1G of allowed memory |
| # |
Oct 2nd 2016, 16:22 |
lorb |
large amounts = number of records has 6 digits |
| # |
Oct 2nd 2016, 16:22 |
lorb |
how can I handle large amounts of data in cakephp2 ? |
| # |
Oct 2nd 2016, 16:20 |
michaelze |
(i.e. beforeFind()) |
| # |
Oct 2nd 2016, 16:20 |
michaelze |
Hi everyone! Is there a way to modify a query by a behavior the moment it is created instead of the moment that it is executed? |
| # |
Oct 2nd 2016, 16:18 |
 noibilism |
Helloâ?¦anybody know any nice drag and drop file uploader script out there that can be implemented with cake 3? |
| # |
Oct 2nd 2016, 13:30 |
admad |
use gist or pastebin |
| # |
Oct 2nd 2016, 13:30 |
admad |
phpcakebaker: show the full stacktrace for the error |
| # |
Oct 2nd 2016, 13:26 |
phpcakebaker |
I believe that match the controller name do not need to be loaded or set to a property manually. |
| # |
Oct 2nd 2016, 13:24 |
phpcakebaker |
Hello, I am doing the tutorial at http://www.bravo-kernel.com/2015/04/how-to-add-jwt-authentication-to-a-cakephp-3-rest-api/ and I run into an error that I would like to understand and solve. When I add a new user, as instructed in the tutorial I get an error Call to a member function success() on boolean |
| # |
Oct 2nd 2016, 10:10 |
kingloui |
it seems that it writes a bad cookie, because it can read a cookie written by cakephp 3.3.4 but when I login again it canâ??t read the cookie |
| # |
Oct 2nd 2016, 10:08 |
kingloui |
e |
| # |
Oct 2nd 2016, 10:08 |
kingloui |
when I downgrade to cakephp 3.3.4 it is working fin |
| # |
Oct 2nd 2016, 10:08 |
kingloui |
anyone else having problems with CakeDC/Users RememberMe not working with cakephp 3.3.5? |
| # |
Oct 2nd 2016, 09:19 |
birdy247 |
Morning bakersssssssss |
| # |
Oct 2nd 2016, 08:57 |
lorb |
for some reason cakephp has a fatal error of memory exhaustion when trying to save 100k rows, which shouldn't be a problem with 1G of allowed memory |
| # |
Oct 2nd 2016, 08:55 |
lorb |
large amounts = number of records has 6 digits |
| # |
Oct 2nd 2016, 08:54 |
lorb |
how can I handle large amounts of data in cakephp2 ? |
| # |
Oct 2nd 2016, 02:22 |
moose517 |
booored ROFL |
| # |
Oct 2nd 2016, 01:43 |
ndm |
np |
| # |
Oct 2nd 2016, 01:43 |
waspinator |
thanks @ndm |
| # |
Oct 2nd 2016, 01:43 |
waspinator |
oh so just `->matching('Association')` would work |
| # |
Oct 2nd 2016, 01:42 |
ndm |
@waspinator You don't need to pass the second argument at all |
| # |
Oct 2nd 2016, 01:39 |
waspinator |
pretty good. whats up |
| # |
Oct 2nd 2016, 01:39 |
moose517 |
how are you |
| # |
Oct 2nd 2016, 01:39 |
waspinator |
hi moose |
| # |
Oct 2nd 2016, 01:39 |
waspinator |
hmm, just returning `$q` worked |