{"id":957,"date":"2007-08-06T00:00:00","date_gmt":"2007-08-05T22:00:00","guid":{"rendered":"https:\/\/wwwneu.strehle.de\/tim\/weblog\/archives\/2007\/08\/06\/895\/"},"modified":"2007-08-06T00:00:00","modified_gmt":"2007-08-05T22:00:00","slug":"895","status":"publish","type":"post","link":"https:\/\/www.strehle.de\/tim\/weblog\/archives\/2007\/08\/06\/895\/","title":{"rendered":"MegaData"},"content":{"rendered":"<p>Joe Gregorio &#8211; <a href=\"http:\/\/bitworking.org\/news\/158\/ETech-07-Summary-Part-2-MegaData\">ETech &#8217;07 Summary &#8211; Part 2 &#8211; MegaData<\/a>:<\/p>\n<p>&#8222;If you want to scale to the petabyte level, or the billion requests a day, you need to be:<\/p>\n<dl>\n<dt>Distributed<\/dt>\n<dd>The data has to be distributed across multiple machines.<\/dd>\n<dt>Joinless<\/dt>\n<dd>No joins, and no referential integrity, at least at the data store level.<\/dd>\n<dt>De-Normalized<\/dt>\n<dd>No one said this explicily, but I presume there is a lot of de-normalization going on if you are avoiding joins.<\/dd>\n<dt>Transcationless<\/dt>\n<dd>No transactions<\/dd>\n<\/dl>\n<p>Those constraints represent something fundamentally different from a relational database.&#8220;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Joe Gregorio &#8211; ETech &#8217;07 Summary &#8211; Part 2 &#8211; MegaData: &#8222;If you want to scale to the petabyte level, or the billion requests a day, you need to be: Distributed The data has to be distributed across multiple machines. Joinless No joins, and no referential integrity, at least at the data store level. De-Normalized [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_share_on_mastodon":"0"},"categories":[1],"tags":[],"class_list":["post-957","post","type-post","status-publish","format-standard","hentry","category-weblog"],"share_on_mastodon":{"url":"","error":""},"_links":{"self":[{"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/posts\/957","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/comments?post=957"}],"version-history":[{"count":0,"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/posts\/957\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/media?parent=957"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/categories?post=957"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.strehle.de\/tim\/wp-json\/wp\/v2\/tags?post=957"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}