# |
Aug 9th 2008, 05:38 |
AD7six |
Howard``: using something that is none-linear to shard on will give you poor performance |
# |
Aug 9th 2008, 05:38 |
achew22 |
AD7six: did you know that prager from Revision 3 writes in cake? |
# |
Aug 9th 2008, 05:37 |
AD7six |
Howard``: I wouldn't set a fixed idea on the number of dbs - use a formula and factor to define the limits. so that you can say "well, 1 db isn't enough - change $n to 2, resync dbs (move things around) and off we go again" |
# |
Aug 9th 2008, 05:36 |
Howard`` |
it's a Joint Venture as they refer to it |
# |
Aug 9th 2008, 05:36 |
achew22 |
AD7six: damn me... cascade huh. Thanks |
# |
Aug 9th 2008, 05:36 |
Howard`` |
These people only make money based on referrals and are tight on who they'll brand apparently |
# |
Aug 9th 2008, 05:35 |
Howard`` |
even if the conversion rate was 1% that would be a pretty significant load from the getgo |
# |
Aug 9th 2008, 05:34 |
Howard`` |
They're expecting to reach out to about 500k people |
# |
Aug 9th 2008, 05:34 |
Howard`` |
well the people i'm going to be marketing through are only going to be making money through referrals |
# |
Aug 9th 2008, 05:34 |
AD7six |
Howard``: why think about sharding right at the beginning |
# |
Aug 9th 2008, 05:33 |
AD7six |
achew22: I'm not a screen reader - and the answer is right in front of you. |
# |
Aug 9th 2008, 05:33 |
Howard`` |
something along the lines of a base26 shard for asset references, then a dynamic database structure which holds the related user information and records, this would allow their entire account to be moved at any time needed. |
# |
Aug 9th 2008, 05:32 |
Howard`` |
pretty much AD7six, i'm thinking that could work |
# |
Aug 9th 2008, 05:32 |
achew22 |
AD7six: from the API it looks like you just pass conditions (required) http://api.cakephp.org/class_model.html#e479060f5069beff0f8888b70a314ff1 |
# |
Aug 9th 2008, 05:32 |
AD7six |
Howard``: semi linchpin like. |
# |
Aug 9th 2008, 05:31 |
Howard`` |
I'm thinking maybe, a lightweight asset table which contains a user id association to a database, when this lookup is done, it references that database for all user information and records |
# |
Aug 9th 2008, 05:31 |
AD7six |
achew22: delete all has 2 modes - tell me what they are |
# |
Aug 9th 2008, 05:31 |
Howard`` |
yeah, trying to figure that ouw now AD7six |
# |
Aug 9th 2008, 05:30 |
achew22 |
no, its doing a select instead of a delete |
# |
Aug 9th 2008, 05:30 |
AD7six |
achew22: if it works yes. if you're getting ambiguous field errors no. |
# |
Aug 9th 2008, 05:29 |
AD7six |
Howard``: entirely up to you. remember that the more you shard the more cross db joins you risk/need. |
# |
Aug 9th 2008, 05:29 |
achew22 |
AD7six: is this what your meant? http://bin.cakephp.org/view/543725084 |
# |
Aug 9th 2008, 05:28 |
Howard`` |
AD7six, curious, would it be disasterous to make a seperate db for each user id? |
# |
Aug 9th 2008, 05:27 |
kaotisch |
achew did you want me to paste my code to the bin, or did you mean someone else? |
# |
Aug 9th 2008, 05:26 |
AD7six |
achew22: $condition['Not']['Model.field'] = $arrayOrId |
# |
Aug 9th 2008, 05:26 |
achew22 |
its not really intuitive I am trying to delete all the things in the DB that aren't in $results |
# |
Aug 9th 2008, 05:26 |
AD7six |
since when is that intuitive |
# |
Aug 9th 2008, 05:26 |
AD7six |
achew22: where did you get " '`id` NOT' " from |
# |
Aug 9th 2008, 05:25 |
Howard`` |
not sure if that's logical |
# |
Aug 9th 2008, 05:25 |
Howard`` |
What I'm thinking about doing here is allowing like 100 accounts per database |
# |
Aug 9th 2008, 05:25 |
achew22 |
AD7six: would you be willing to look at this? http://bin.cakephp.org/view/23017039 |
# |
Aug 9th 2008, 05:25 |
Howard`` |
yeah :) |
# |
Aug 9th 2008, 05:25 |
AD7six |
Howard``: a base26 sharding system :) |
# |
Aug 9th 2008, 05:24 |
Howard`` |
something along the lines of 26 databases depending on the first character of the username |
# |
Aug 9th 2008, 05:24 |
pgcd_away |
ok, i'm having serious trouble getting swfupload 2.1 to work with cake 1.2, and there seem to be no useful tutorial... anybody here has done something with it? |
# |
Aug 9th 2008, 05:24 |
Howard`` |
I've seen sharding in use actually |
# |
Aug 9th 2008, 05:24 |
AD7six |
Howard``: well that's effectively dbo layer logic - i.e. doesn't influence any of your app code at all if it's done right. |
# |
Aug 9th 2008, 05:22 |
AD7six |
Howard``: you'd be better off thinking about sharding etc. if/when you have to of course. |
# |
Aug 9th 2008, 05:22 |
Howard`` |
thanks AD7six, checking that and sharding out now |
# |
Aug 9th 2008, 05:21 |
achew22 |
hrm... |
# |
Aug 9th 2008, 05:21 |
AD7six |
achew22: yes |