Log message #4151485

# At Username Text
# Jun 14th 2018, 14:00 alexmax I've got a query object that I'm cloning and adding conditions to to run lots of similar queries
# Jun 14th 2018, 14:00 alexmax There is no way to remove a particular condition from a query object is there?
# Jun 14th 2018, 13:36 josbeir love ES tho! writing a whole ecommerce platform on it and using ES as its main store instead, its mature enough these days to do such things now
# Jun 14th 2018, 13:35 josbeir @lorenzomaieru ES is indeed better for such things, just take care of memory management because that can cause a bit of issues
# Jun 14th 2018, 13:25 jeremyharris I write my own because sometimes I need special formatting, such as formatting dates as the user requests and in their timezone
# Jun 14th 2018, 13:24 jeremyharris if that’s not something you want to do, there’s always https://github.com/FriendsOfCake/cakephp-csvview
# Jun 14th 2018, 13:23 jeremyharris you can make a view that uses the _serialize var to do it
# Jun 14th 2018, 13:23 jeremyharris oh yeah I just use the SPL functions like @neon1024 is suggesting
# Jun 14th 2018, 13:23 neon1024 Oh, it’s `fputcsv()`
# Jun 14th 2018, 13:23 itmpls not parsing
# Jun 14th 2018, 13:23 itmpls i'm generating it and making it downloadable
# Jun 14th 2018, 13:23 itmpls standard just to download, sorry
# Jun 14th 2018, 13:23 jeremyharris or just for working with them
# Jun 14th 2018, 13:22 jeremyharris as a view?
# Jun 14th 2018, 13:22 itmpls heh
# Jun 14th 2018, 13:22 neon1024 `file_put_csv()`
# Jun 14th 2018, 13:22 itmpls can anyone recommend a csv solution/plugin?
# Jun 14th 2018, 13:22 itmpls i see
# Jun 14th 2018, 13:19 lorenzo postgres is a good alternative as well, except for the disk problem
# Jun 14th 2018, 13:19 lorenzo in mysql there is no alternative, and in postgres you have to add the indexes manually
# Jun 14th 2018, 13:19 lorenzo it creates indexes dedicated for search
# Jun 14th 2018, 13:17 itmpls you store what you want in the doc, no relational stuff/joining and just fast parsing
# Jun 14th 2018, 13:16 itmpls basically like no-sql dbs?
# Jun 14th 2018, 13:16 itmpls how does that work? it serializes and just has an insanely fast parser?
# Jun 14th 2018, 13:15 lorenzo so it was s solid win
# Jun 14th 2018, 13:15 lorenzo but, it also allows instant searches on historic data, by nested columns as well
# Jun 14th 2018, 13:15 itmpls jeez
# Jun 14th 2018, 13:15 lorenzo we ran into a situation where the audit log tables we over 200Gb, and deleting from them would block the database
# Jun 14th 2018, 13:14 lorenzo but you can scale ES easier by adding more machines
# Jun 14th 2018, 13:14 lorenzo to be honest, the main reason elastic search is the default is because disk space for databases is expensive
# Jun 14th 2018, 13:14 itmpls but I imagine ES would be the go-to for a bigger db/overall so it does the decoding natively? haven't used ES that much
# Jun 14th 2018, 13:13 itmpls err - elastic search*
# Jun 14th 2018, 13:13 itmpls i did get a solution, but i did it nasty because i'm json_decoding the columns - i'm guessing that's why lucene is recommended. for my database, this report is run manually and there aren't going to be more than 100 users probably so
# Jun 14th 2018, 13:13 lorenzo @itmpls I imagined it had to do with a nested trasaction
# Jun 14th 2018, 13:13 spriz I’ll make sure to bring enough coffee :,)
# Jun 14th 2018, 13:13 lorenzo haha
# Jun 14th 2018, 13:13 lorenzo exciting
# Jun 14th 2018, 13:12 spriz @lorenzo found a commit in october 2017 where things work - so I’ll go ahead with git bisect tomorrow - I’ll update you :)
# Jun 14th 2018, 13:12 itmpls basically not having the proper "dirty" logic, and also having to manually do the audit trail saveOptions in a nested transaction
# Jun 14th 2018, 13:11 lorenzo what was the problem/
# Jun 14th 2018, 13:11 lorenzo yay!