Conversation

Elon Musk's favorite supposed data expert, who he's retweeted at least a dozen times, claims she can only process 60,000 rows of data before her "hard drive overheats".

Perhaps someone should rescue her from where she's apparently stuck twenty years in the past, which is the only possible explanation for those hardware limitations and the apparent lack of access to cloud compute.

Unless, of course, she's just completely making shit up.

22
16
1
@molly0xfff Her query may also have non-linear complexity, 60k rows is nothing.
3
0
2

@molly0xfff

Wait, what?

How poorly set up is her database that she can only run 60k rows? I can do that trivially on sqlite running on a raspberry pi.

My assumption is that she's simply lying, but I'm now awake pre-6am wondering if it would be possible to do that on purpose with modern hardware and software. Even indexing improperly and then doing joins on string columns wouldn't give that sort of anti-performance.

1
0
1

@passenger Perhaps if she moved the hard drive from where she left it on the radiator...

0
0
0

@molly0xfff 🙂 20 years ago brings me to 2005 where my trusty few-years-old single core 600MHz sun workstation would run *grep* over 60k lines in a text file in a few secs without anything overheating.

0
0
0

@buherator @molly0xfff I am suspecting that you have an "excel" data expert...

0
0
1

@molly0xfff You've gotta be doing something specially dumb to have 60k rows trip you up. I've played with spreadsheets with more rows....

3
0
0

@LovesTha @molly0xfff whoa whoa whoa, how do your spreadsheets go beyond 65536 rows? /s

(The quoted number is suspiciously close to this)

1
1
0

@molly0xfff (I was doing something particularly dumb)

0
0
0

@molly0xfff Well Im no db-guy, but this sounds like utter BS.

0
1
0

@skinnylatte @molly0xfff Seriously, I bet a good programmer could get that workable on a TI-83.

1
1
0

@molly0xfff or she's working on data on an offline network to avoid data leakages or Intel on what she is working on...what type de data she is working on? 🙂

0
1
0

@SecurityWriter @Viss @drsbaitso @skinnylatte @molly0xfff could probably processed the data whilst playing a banging sound tracker in the background you philistine.

0
0
0

@molly0xfff 60000 records, like about what an average router from 10 years ago has in its routing table?

0
1
0
@molly0xfff also, this reply captures the X vibe perfectly:
4
1
12

@skinnylatte @molly0xfff
Actually Excel (until 2003) had a row limit of 65,536.
This could mean she is using Excel 2003 to process her data 🤡
(this doesn't "explain" the harddisk overheating 🤪)

0
1
0

@SecurityWriter @Viss @drsbaitso @skinnylatte @molly0xfff whilst you play defender of the crown waiting for it to finish.

0
0
0

@molly0xfff Maybe somebody should get a computer from this century before trying to do data analysis?

0
1
0

@LovesTha @molly0xfff the old 32-bit Excel limit was 64k, right? Maybe they are stuck on Office 2005. Which is funny in so many ways in my Head. Starting from 'Excel?' to my new head canon that they rejected to upgrade because they hated the ribbon layout.

1
0
0

@develin @molly0xfff have they removed that limitation yet? I know libreOffice copied that limit so people abusing the roll over had compatibility.

1
0
0

@LovesTha @develin @molly0xfff Both Excel and LibreOffice Calc now support 1048576 rows.

0
1
0

@aspensmonster @molly0xfff I'm guessing he's calling the tower "hard drive" – a lot of clueless users do this.

0
1
0

@molly0xfff In my 30+ years of working with computers I've never had a "hard drive overheat".

0
1
0

@GuillaumeRossolini @LovesTha @molly0xfff I've used a spreadsheet where rows from 65536 onwards were wrong, but that was a bug in the tool that generated the spreadsheet from another data source.
Excel from "twenty years in the past" might not handle it though.

1
1
0

@armb @LovesTha @molly0xfff yeah that’s a given, but if this person is using excel (and so outdated), that’s not a great look 😂

0
1
0

@buherator @molly0xfff

Feels like AI Chatbots making up stories.

0
0
0

@molly0xfff Is ‘My hard drive overheated’ the new ‘My dog ate my homework’?

0
0
0

@molly0xfff She should learn Excel. It’s a good tool for people at her skill level.

0
1
0

@molly0xfff Their hardware is up to date, but the issue is that they have it set up in a bathhouse so they don't miss the weekly "conservative family values" meeting.

0
0
0

@molly0xfff oh, I can believe someone in a government is using a old copy of Excel as part of their workflow
https://www.bbc.co.uk/news/technology-54423988

0
0
0

@molly0xfff I'm looking forward to sharing this with the storage team at work.

0
0
0

@buherator @molly0xfff 60k rows is a telltale Excel mark, so either they try looking credible for beginners or it’s indeed a “fact” easily parroted by AI

0
0
0
Even if they were trying to run some blockchain database on his laptop and did the queries in the most inefficient way this problem still wouldn't manifest.
0
0
0

@molly0xfff This is because her database is on chain. Not only does each query overheat her hard drive, it also costs $100,000 in gas fees.

0
1
0

@sophieschmieg @molly0xfff I had too, but then I talked to somebody trying to do some analysis using Excel, and they reminded me that some tools indeed have trouble with that size of data set.

0
0
0

@rubinjoni @Viss @molly0xfff I literally built a database DESIGNED not to scale (because Small Web) and it can churn 60,000 rows and spit it out as if it was chewing gum.

60,000 rows is not a challenge unless you’re on a Commodore 64.

0
0
0

@buherator @molly0xfff Hmmm
- large data set
- 60k rows

Pick one, it can't be both.

0
0
0

@molly0xfff Not to give too much benefit of the doubt, but she *is* currently working in the government…

0
0
0