# |
Aug 9th 2008, 05:39 |
AD7six |
Howard``: via query at a guess. |
# |
Aug 9th 2008, 05:39 |
Howard`` |
Databases |
# |
Aug 9th 2008, 05:39 |
Howard`` |
not tables.. |
# |
Aug 9th 2008, 05:39 |
Howard`` |
They are, is it possible to get cake to generate tables on the fly by the way? |
# |
Aug 9th 2008, 05:38 |
AD7six |
if arbitary shards are the goal taht is |
# |
Aug 9th 2008, 05:38 |
Howard`` |
yeah I'm trying to understand all of this performance stuff, it's a lot to take in really |
# |
Aug 9th 2008, 05:38 |
AD7six |
Howard``: use something like the last char (or last 2 chars) of the numeric/random id. |
# |
Aug 9th 2008, 05:38 |
AD7six |
Howard``: using something that is none-linear to shard on will give you poor performance |
# |
Aug 9th 2008, 05:38 |
achew22 |
AD7six: did you know that prager from Revision 3 writes in cake? |
# |
Aug 9th 2008, 05:37 |
AD7six |
Howard``: I wouldn't set a fixed idea on the number of dbs - use a formula and factor to define the limits. so that you can say "well, 1 db isn't enough - change $n to 2, resync dbs (move things around) and off we go again" |
# |
Aug 9th 2008, 05:36 |
Howard`` |
it's a Joint Venture as they refer to it |
# |
Aug 9th 2008, 05:36 |
achew22 |
AD7six: damn me... cascade huh. Thanks |
# |
Aug 9th 2008, 05:36 |
Howard`` |
These people only make money based on referrals and are tight on who they'll brand apparently |
# |
Aug 9th 2008, 05:35 |
Howard`` |
even if the conversion rate was 1% that would be a pretty significant load from the getgo |
# |
Aug 9th 2008, 05:34 |
Howard`` |
They're expecting to reach out to about 500k people |
# |
Aug 9th 2008, 05:34 |
Howard`` |
well the people i'm going to be marketing through are only going to be making money through referrals |
# |
Aug 9th 2008, 05:34 |
AD7six |
Howard``: why think about sharding right at the beginning |
# |
Aug 9th 2008, 05:33 |
AD7six |
achew22: I'm not a screen reader - and the answer is right in front of you. |
# |
Aug 9th 2008, 05:33 |
Howard`` |
something along the lines of a base26 shard for asset references, then a dynamic database structure which holds the related user information and records, this would allow their entire account to be moved at any time needed. |
# |
Aug 9th 2008, 05:32 |
Howard`` |
pretty much AD7six, i'm thinking that could work |
# |
Aug 9th 2008, 05:32 |
achew22 |
AD7six: from the API it looks like you just pass conditions (required) http://api.cakephp.org/class_model.html#e479060f5069beff0f8888b70a314ff1 |
# |
Aug 9th 2008, 05:32 |
AD7six |
Howard``: semi linchpin like. |
# |
Aug 9th 2008, 05:31 |
Howard`` |
I'm thinking maybe, a lightweight asset table which contains a user id association to a database, when this lookup is done, it references that database for all user information and records |
# |
Aug 9th 2008, 05:31 |
AD7six |
achew22: delete all has 2 modes - tell me what they are |
# |
Aug 9th 2008, 05:31 |
Howard`` |
yeah, trying to figure that ouw now AD7six |
# |
Aug 9th 2008, 05:30 |
achew22 |
no, its doing a select instead of a delete |
# |
Aug 9th 2008, 05:30 |
AD7six |
achew22: if it works yes. if you're getting ambiguous field errors no. |
# |
Aug 9th 2008, 05:29 |
AD7six |
Howard``: entirely up to you. remember that the more you shard the more cross db joins you risk/need. |
# |
Aug 9th 2008, 05:29 |
achew22 |
AD7six: is this what your meant? http://bin.cakephp.org/view/543725084 |
# |
Aug 9th 2008, 05:28 |
Howard`` |
AD7six, curious, would it be disasterous to make a seperate db for each user id? |
# |
Aug 9th 2008, 05:27 |
kaotisch |
achew did you want me to paste my code to the bin, or did you mean someone else? |
# |
Aug 9th 2008, 05:26 |
AD7six |
achew22: $condition['Not']['Model.field'] = $arrayOrId |
# |
Aug 9th 2008, 05:26 |
achew22 |
its not really intuitive I am trying to delete all the things in the DB that aren't in $results |
# |
Aug 9th 2008, 05:26 |
AD7six |
since when is that intuitive |
# |
Aug 9th 2008, 05:26 |
AD7six |
achew22: where did you get " '`id` NOT' " from |
# |
Aug 9th 2008, 05:25 |
Howard`` |
not sure if that's logical |
# |
Aug 9th 2008, 05:25 |
Howard`` |
What I'm thinking about doing here is allowing like 100 accounts per database |
# |
Aug 9th 2008, 05:25 |
achew22 |
AD7six: would you be willing to look at this? http://bin.cakephp.org/view/23017039 |
# |
Aug 9th 2008, 05:25 |
Howard`` |
yeah :) |
# |
Aug 9th 2008, 05:25 |
AD7six |
Howard``: a base26 sharding system :) |
# |
Aug 9th 2008, 05:24 |
Howard`` |
something along the lines of 26 databases depending on the first character of the username |