neodata686 All American 11577 Posts user info edit post |
How many rows does your DB have? 11/15/2012 4:42:20 PM |
jakis Suspended 1415 Posts user info edit post |
[Edited on November 15, 2012 at 4:52 PM. Reason : NERD'S]
11/15/2012 4:52:17 PM |
quagmire02 All American 44225 Posts user info edit post |
entire database or in a single table? 11/15/2012 7:24:34 PM |
smoothcrim Universal Magnetic! 18964 Posts user info edit post |
a few quadrillion 11/15/2012 7:33:19 PM |
neodata686 All American 11577 Posts user info edit post |
Bazillion!
^^From my estimates one of our tables may be hitting a trillion soon. I know it's at least 500 billion+.
To be fair it's MPP architecture so technically it's split up into lots of sub-tables and the master queries the primary table by using a distribution key but for my purposes it's still one table.
-just thought it was cool. My company deals with big data and I'm just now learning a lot about database architecture and SQL. It's pretty neato.
[Edited on November 15, 2012 at 8:00 PM. Reason : s] 11/15/2012 7:59:20 PM |
smoothcrim Universal Magnetic! 18964 Posts user info edit post |
i was serious about a few quadrillion.. 11/15/2012 8:07:15 PM |
neodata686 All American 11577 Posts user info edit post |
11/15/2012 8:24:42 PM |
MisterGreen All American 4328 Posts user info edit post |
i have a hard time wrapping my head around numbers that large.
a quadrillion? geez. 11/15/2012 8:58:00 PM |
gs7 All American 2354 Posts user info edit post |
So who do you guys use for your big data storage backend?
How many clients do you have accessing that data?
Rows are interesting, but the infrastructure is the cool stuff. 11/15/2012 9:14:03 PM |
smoothcrim Universal Magnetic! 18964 Posts user info edit post |
aws.amazon.com
[Edited on November 15, 2012 at 9:34 PM. Reason : dynamodb - nosql] 11/15/2012 9:29:58 PM |
neodata686 All American 11577 Posts user info edit post |
We have our own hardware. Hosted or behind the clients firewall (depending on the type of client). Postgresql using Greenplum. Which is awesome.
http://www.greenplum.com/products/greenplum-database 11/15/2012 9:57:29 PM |
Tarun almost 11687 Posts user info edit post |
nvm
[Edited on November 16, 2012 at 12:08 PM. Reason : dint read it right] 11/16/2012 12:07:18 PM |
afripino All American 11397 Posts user info edit post |
how long does a select * take?
[Edited on November 16, 2012 at 12:15 PM. Reason : eleventy billion in my DB's] 11/16/2012 12:15:09 PM |
neodata686 All American 11577 Posts user info edit post |
Under a minute if there's no big joins. 11/16/2012 12:57:59 PM |
smoothcrim Universal Magnetic! 18964 Posts user info edit post |
no relations so subsecond 11/16/2012 1:28:13 PM |
neodata686 All American 11577 Posts user info edit post |
Well aren't you too cool for school. 11/16/2012 1:46:02 PM |
Tarun almost 11687 Posts user info edit post |
e-peen contest? 11/16/2012 1:48:04 PM |
neodata686 All American 11577 Posts user info edit post |
Doesn't count unless it's hosted with your own hardware. 11/16/2012 1:49:52 PM |
AntecK7 All American 7755 Posts user info edit post |
I feel the need to post this
https://www.youtube.com/watch?v=b2F-DItXtZs 11/21/2012 12:03:50 AM |
Arab13 Art Vandelay 45166 Posts user info edit post |
I'd say 32. The last time he got cornrows there was a good number of them. 11/29/2012 2:10:30 AM |
r45t4-m4n All American 629 Posts user info edit post |
We use GreenPlum, Netezza, MS SQL and and old DB2 here. Every month one of the tables I work with gets ~180 million rows added. There are multiple tables like this, with historic data for about 12 years. We are phasing out netezza and DB2, I am responsible for the ETL from those servers using informatica. 11/30/2012 12:48:50 PM |
Stein All American 19842 Posts user info edit post |
For any of you who record lots of time-series data, I have some friends who run a hosted database just for that: http://tempo-db.com/
Awesome guys, solid product. 11/30/2012 3:26:31 PM |
smoothcrim Universal Magnetic! 18964 Posts user info edit post |
http://aws.amazon.com/redshift/ 11/30/2012 4:54:45 PM |