# |
Jun 14th 2018, 14:00 |
alexmax |
I've got a query object that I'm cloning and adding conditions to to run lots of similar queries |
# |
Jun 14th 2018, 14:00 |
alexmax |
There is no way to remove a particular condition from a query object is there? |
# |
Jun 14th 2018, 13:36 |
josbeir |
love ES tho! writing a whole ecommerce platform on it and using ES as its main store instead, its mature enough these days to do such things now |
# |
Jun 14th 2018, 13:35 |
josbeir |
@lorenzomaieru ES is indeed better for such things, just take care of memory management because that can cause a bit of issues |
# |
Jun 14th 2018, 13:25 |
jeremyharris |
I write my own because sometimes I need special formatting, such as formatting dates as the user requests and in their timezone |
# |
Jun 14th 2018, 13:24 |
jeremyharris |
if that’s not something you want to do, there’s always https://github.com/FriendsOfCake/cakephp-csvview |
# |
Jun 14th 2018, 13:23 |
jeremyharris |
you can make a view that uses the _serialize var to do it |
# |
Jun 14th 2018, 13:23 |
jeremyharris |
oh yeah I just use the SPL functions like @neon1024 is suggesting |
# |
Jun 14th 2018, 13:23 |
neon1024 |
Oh, it’s `fputcsv()` |
# |
Jun 14th 2018, 13:23 |
itmpls |
not parsing |
# |
Jun 14th 2018, 13:23 |
itmpls |
i'm generating it and making it downloadable |
# |
Jun 14th 2018, 13:23 |
itmpls |
standard just to download, sorry |
# |
Jun 14th 2018, 13:23 |
jeremyharris |
or just for working with them |
# |
Jun 14th 2018, 13:22 |
jeremyharris |
as a view? |
# |
Jun 14th 2018, 13:22 |
itmpls |
heh |
# |
Jun 14th 2018, 13:22 |
neon1024 |
`file_put_csv()` |
# |
Jun 14th 2018, 13:22 |
itmpls |
can anyone recommend a csv solution/plugin? |
# |
Jun 14th 2018, 13:22 |
itmpls |
i see |
# |
Jun 14th 2018, 13:19 |
lorenzo |
postgres is a good alternative as well, except for the disk problem |
# |
Jun 14th 2018, 13:19 |
lorenzo |
in mysql there is no alternative, and in postgres you have to add the indexes manually |
# |
Jun 14th 2018, 13:19 |
lorenzo |
it creates indexes dedicated for search |
# |
Jun 14th 2018, 13:17 |
itmpls |
you store what you want in the doc, no relational stuff/joining and just fast parsing |
# |
Jun 14th 2018, 13:16 |
itmpls |
basically like no-sql dbs? |
# |
Jun 14th 2018, 13:16 |
itmpls |
how does that work? it serializes and just has an insanely fast parser? |
# |
Jun 14th 2018, 13:15 |
lorenzo |
so it was s solid win |
# |
Jun 14th 2018, 13:15 |
lorenzo |
but, it also allows instant searches on historic data, by nested columns as well |
# |
Jun 14th 2018, 13:15 |
itmpls |
jeez |
# |
Jun 14th 2018, 13:15 |
lorenzo |
we ran into a situation where the audit log tables we over 200Gb, and deleting from them would block the database |
# |
Jun 14th 2018, 13:14 |
lorenzo |
but you can scale ES easier by adding more machines |
# |
Jun 14th 2018, 13:14 |
lorenzo |
to be honest, the main reason elastic search is the default is because disk space for databases is expensive |
# |
Jun 14th 2018, 13:14 |
itmpls |
but I imagine ES would be the go-to for a bigger db/overall so it does the decoding natively? haven't used ES that much |
# |
Jun 14th 2018, 13:13 |
itmpls |
err - elastic search* |
# |
Jun 14th 2018, 13:13 |
itmpls |
i did get a solution, but i did it nasty because i'm json_decoding the columns - i'm guessing that's why lucene is recommended. for my database, this report is run manually and there aren't going to be more than 100 users probably so |
# |
Jun 14th 2018, 13:13 |
lorenzo |
@itmpls I imagined it had to do with a nested trasaction |
# |
Jun 14th 2018, 13:13 |
spriz |
I’ll make sure to bring enough coffee :,) |
# |
Jun 14th 2018, 13:13 |
lorenzo |
haha |
# |
Jun 14th 2018, 13:13 |
lorenzo |
exciting |
# |
Jun 14th 2018, 13:12 |
spriz |
@lorenzo found a commit in october 2017 where things work - so I’ll go ahead with git bisect tomorrow - I’ll update you :) |
# |
Jun 14th 2018, 13:12 |
itmpls |
basically not having the proper "dirty" logic, and also having to manually do the audit trail saveOptions in a nested transaction |
# |
Jun 14th 2018, 13:11 |
lorenzo |
what was the problem/ |
# |
Jun 14th 2018, 13:11 |
lorenzo |
yay! |