| # |
Aug 9th 2008, 05:42 |
Howard`` |
isn't there a performance gain if you have 10 databases of 100k rows rather than 1 database of 1 million rows? |
| # |
Aug 9th 2008, 05:42 |
AD7six |
premature optimization otherwise. |
| # |
Aug 9th 2008, 05:42 |
AD7six |
Howard``: indexes -> dedicated db server -> clusters -> sharding. |
| # |
Aug 9th 2008, 05:41 |
AD7six |
Howard``: that's imo pretty much pointless. |
| # |
Aug 9th 2008, 05:41 |
Howard`` |
initially, after the first week or month i plan on spanning across a minimum of two servers |
| # |
Aug 9th 2008, 05:40 |
AD7six |
Howard``: are you thinking of putting (e.g.) 26 dbs, split on the same server? |
| # |
Aug 9th 2008, 05:40 |
Howard`` |
What I want to avoid is having a database with so much information that pulling 50 specific rows is going to strain the entire server |
| # |
Aug 9th 2008, 05:40 |
AD7six |
Howard``: might be directly possible have a look at schemas although I (atm) assume they expect a db to exist beforehand |
| # |
Aug 9th 2008, 05:39 |
AD7six |
Howard``: via query at a guess. |
| # |
Aug 9th 2008, 05:39 |
Howard`` |
Databases |
| # |
Aug 9th 2008, 05:39 |
Howard`` |
not tables.. |
| # |
Aug 9th 2008, 05:39 |
Howard`` |
They are, is it possible to get cake to generate tables on the fly by the way? |
| # |
Aug 9th 2008, 05:38 |
AD7six |
if arbitary shards are the goal taht is |
| # |
Aug 9th 2008, 05:38 |
Howard`` |
yeah I'm trying to understand all of this performance stuff, it's a lot to take in really |
| # |
Aug 9th 2008, 05:38 |
AD7six |
Howard``: use something like the last char (or last 2 chars) of the numeric/random id. |
| # |
Aug 9th 2008, 05:38 |
AD7six |
Howard``: using something that is none-linear to shard on will give you poor performance |
| # |
Aug 9th 2008, 05:38 |
achew22 |
AD7six: did you know that prager from Revision 3 writes in cake? |
| # |
Aug 9th 2008, 05:37 |
AD7six |
Howard``: I wouldn't set a fixed idea on the number of dbs - use a formula and factor to define the limits. so that you can say "well, 1 db isn't enough - change $n to 2, resync dbs (move things around) and off we go again" |
| # |
Aug 9th 2008, 05:36 |
Howard`` |
it's a Joint Venture as they refer to it |
| # |
Aug 9th 2008, 05:36 |
achew22 |
AD7six: damn me... cascade huh. Thanks |
| # |
Aug 9th 2008, 05:36 |
Howard`` |
These people only make money based on referrals and are tight on who they'll brand apparently |
| # |
Aug 9th 2008, 05:35 |
Howard`` |
even if the conversion rate was 1% that would be a pretty significant load from the getgo |
| # |
Aug 9th 2008, 05:34 |
Howard`` |
They're expecting to reach out to about 500k people |
| # |
Aug 9th 2008, 05:34 |
Howard`` |
well the people i'm going to be marketing through are only going to be making money through referrals |
| # |
Aug 9th 2008, 05:34 |
AD7six |
Howard``: why think about sharding right at the beginning |
| # |
Aug 9th 2008, 05:33 |
AD7six |
achew22: I'm not a screen reader - and the answer is right in front of you. |
| # |
Aug 9th 2008, 05:33 |
Howard`` |
something along the lines of a base26 shard for asset references, then a dynamic database structure which holds the related user information and records, this would allow their entire account to be moved at any time needed. |
| # |
Aug 9th 2008, 05:32 |
Howard`` |
pretty much AD7six, i'm thinking that could work |
| # |
Aug 9th 2008, 05:32 |
achew22 |
AD7six: from the API it looks like you just pass conditions (required) http://api.cakephp.org/class_model.html#e479060f5069beff0f8888b70a314ff1 |
| # |
Aug 9th 2008, 05:32 |
AD7six |
Howard``: semi linchpin like. |
| # |
Aug 9th 2008, 05:31 |
Howard`` |
I'm thinking maybe, a lightweight asset table which contains a user id association to a database, when this lookup is done, it references that database for all user information and records |
| # |
Aug 9th 2008, 05:31 |
AD7six |
achew22: delete all has 2 modes - tell me what they are |
| # |
Aug 9th 2008, 05:31 |
Howard`` |
yeah, trying to figure that ouw now AD7six |
| # |
Aug 9th 2008, 05:30 |
achew22 |
no, its doing a select instead of a delete |
| # |
Aug 9th 2008, 05:30 |
AD7six |
achew22: if it works yes. if you're getting ambiguous field errors no. |
| # |
Aug 9th 2008, 05:29 |
AD7six |
Howard``: entirely up to you. remember that the more you shard the more cross db joins you risk/need. |
| # |
Aug 9th 2008, 05:29 |
achew22 |
AD7six: is this what your meant? http://bin.cakephp.org/view/543725084 |
| # |
Aug 9th 2008, 05:28 |
Howard`` |
AD7six, curious, would it be disasterous to make a seperate db for each user id? |
| # |
Aug 9th 2008, 05:27 |
kaotisch |
achew did you want me to paste my code to the bin, or did you mean someone else? |
| # |
Aug 9th 2008, 05:26 |
AD7six |
achew22: $condition['Not']['Model.field'] = $arrayOrId |
| # |
Aug 9th 2008, 05:26 |
achew22 |
its not really intuitive I am trying to delete all the things in the DB that aren't in $results |