| # |
Oct 2nd 2016, 16:45 |
hmic |
michaelze, do you know how and when a query is created? |
| # |
Oct 2nd 2016, 16:45 |
michaelze |
Hi everyone! Is there a way to modify a query by a behavior the moment it is created instead of the moment that it is executed (beforeFind())? |
| # |
Oct 2nd 2016, 16:34 |
michaelze |
lorb: one problem could be that your app is crashing so you won't be able to dump the result... But you could try with as much rows before it is failing. That should give you a pretty good sight into what's happending |
| # |
Oct 2nd 2016, 16:32 |
michaelze |
lorb: I personally don't have a lot of experience on that field (especially not with php). But a quick google search revealed this stackoverflow question: http://stackoverflow.com/questions/880458/php-memory-profiling |
| # |
Oct 2nd 2016, 16:31 |
lorb |
how would I best figure that out? |
| # |
Oct 2nd 2016, 16:31 |
michaelze |
lorb: just an example |
| # |
Oct 2nd 2016, 16:31 |
lorb |
I have turned of validation, and looking for pointers where else cake may require this much memory |
| # |
Oct 2nd 2016, 16:31 |
michaelze |
lorb: well yeah, obviously. what I mean by this is which part of it... Is it generating a lot of caches of some sort that don't get cleaned up? |
| # |
Oct 2nd 2016, 16:30 |
lorb |
well, cakephp is. obviously. running the data directly to mysql gets it done with no trouble |
| # |
Oct 2nd 2016, 16:29 |
michaelze |
lorb: okay, that sounds like something else is taking up the majority :) |
| # |
Oct 2nd 2016, 16:29 |
michaelze |
lorb: I would guess handling a lot of data is not a common task for a orm... |
| # |
Oct 2nd 2016, 16:28 |
lorb |
the records are just a few numbers. the whole data is read from a csv file that has just 3MB |
| # |
Oct 2nd 2016, 16:27 |
michaelze |
lorb: have you analyzed what actually takes up all the space? I mean how big is one of your "row" arrays, what else is there sitting around taking up space? |
| # |
Oct 2nd 2016, 16:25 |
lorb |
yes, I'm rewriting the code atm to do that, but I don't see why that has to be necessary. 100k is not that much data |
| # |
Oct 2nd 2016, 16:25 |
michaelze |
lorb: what about splitting the save operation up into junks? |
| # |
Oct 2nd 2016, 16:24 |
lorb |
I'm using saveAssociated() but yeah, I do have an array with 100k records |
| # |
Oct 2nd 2016, 16:24 |
michaelze |
lorb: can you tell a little bit more about what you are doing? is it some sort of import? |
| # |
Oct 2nd 2016, 16:24 |
lorb |
similaar |
| # |
Oct 2nd 2016, 16:23 |
michaelze |
lorb: do you actually create an array with 100k "rows" and then use saveAll to store them? |
| # |
Oct 2nd 2016, 16:22 |
lorb |
for some reason cakephp has a fatal error of memory exhaustion when trying to save 100k rows, which shouldn't be a problem with 1G of allowed memory |
| # |
Oct 2nd 2016, 16:22 |
lorb |
large amounts = number of records has 6 digits |
| # |
Oct 2nd 2016, 16:22 |
lorb |
how can I handle large amounts of data in cakephp2 ? |
| # |
Oct 2nd 2016, 16:20 |
michaelze |
(i.e. beforeFind()) |
| # |
Oct 2nd 2016, 16:20 |
michaelze |
Hi everyone! Is there a way to modify a query by a behavior the moment it is created instead of the moment that it is executed? |
| # |
Oct 2nd 2016, 16:18 |
 noibilism |
Helloâ?¦anybody know any nice drag and drop file uploader script out there that can be implemented with cake 3? |
| # |
Oct 2nd 2016, 13:30 |
admad |
use gist or pastebin |
| # |
Oct 2nd 2016, 13:30 |
admad |
phpcakebaker: show the full stacktrace for the error |
| # |
Oct 2nd 2016, 13:26 |
phpcakebaker |
I believe that match the controller name do not need to be loaded or set to a property manually. |
| # |
Oct 2nd 2016, 13:24 |
phpcakebaker |
Hello, I am doing the tutorial at http://www.bravo-kernel.com/2015/04/how-to-add-jwt-authentication-to-a-cakephp-3-rest-api/ and I run into an error that I would like to understand and solve. When I add a new user, as instructed in the tutorial I get an error Call to a member function success() on boolean |
| # |
Oct 2nd 2016, 10:10 |
kingloui |
it seems that it writes a bad cookie, because it can read a cookie written by cakephp 3.3.4 but when I login again it canâ??t read the cookie |
| # |
Oct 2nd 2016, 10:08 |
kingloui |
e |
| # |
Oct 2nd 2016, 10:08 |
kingloui |
when I downgrade to cakephp 3.3.4 it is working fin |
| # |
Oct 2nd 2016, 10:08 |
kingloui |
anyone else having problems with CakeDC/Users RememberMe not working with cakephp 3.3.5? |
| # |
Oct 2nd 2016, 09:19 |
birdy247 |
Morning bakersssssssss |
| # |
Oct 2nd 2016, 08:57 |
lorb |
for some reason cakephp has a fatal error of memory exhaustion when trying to save 100k rows, which shouldn't be a problem with 1G of allowed memory |
| # |
Oct 2nd 2016, 08:55 |
lorb |
large amounts = number of records has 6 digits |
| # |
Oct 2nd 2016, 08:54 |
lorb |
how can I handle large amounts of data in cakephp2 ? |
| # |
Oct 2nd 2016, 02:22 |
moose517 |
booored ROFL |
| # |
Oct 2nd 2016, 01:43 |
ndm |
np |
| # |
Oct 2nd 2016, 01:43 |
waspinator |
thanks @ndm |
| # |
Oct 2nd 2016, 01:43 |
waspinator |
oh so just `->matching('Association')` would work |