This shit sounds like when you’re mom tells you that the Facebook printed out her bank statement on the tax machine. I’m not smart enough to even guess how you did something dumb enough to make that happen.
How bad are you at writing queries? How does your hard drive overheat even under 100% load? Do you have it smothered under a blanket? What does running a query on your presumably, remote database even have to do with your harddrive in the first place? Are you trying to copy the entire database locally to a laptop? Do you know how to tie your shoes yet, or are you still on the velcro?
This shit sounds like when you’re mom tells you that the Facebook printed out her bank statement on the tax machine.
My dear sweet mother asked me somewhere around 2005-06 “If we can fax paper, why not groceries, or pizza delivery?”
Apparently she had believed, for decades, that fax machines literally transported physical paper over phone lines. She has a college degree, and my family is wealthy.
Do not underestimate the mind boggling technical and scientific ignorance of old people who should know better.
🤣
A laptop should easily handle a database of 60,000 rows. I run much bigger databases on my own laptop for development purposes.
Not if it is filled to the brim with 3 TB of porn
I can personally vouch for that not causing a problem either.
Delete Ass Master volume 7 to make room - that one wasn’t any good anyways.
Really went downhill after volume 3. You hope that they’ll get back on course by volume 6 at least, but alas.
What in the fuck is this idiot doing? I’ve process datasets far larger than that and never once have I run into a hard drive “overheat”. I mean what level of incompetence do you have to have to get a hard drive to overhead processing a measley 60K rows of data?
I’ve met people who think their desktop PC is the “hard drive” but they’re all over 60.
I’m a data engineer that processes 2 billion row 3000 column datasets every day, and I open shit in Excel with more than 60k rows. What the hell is this chick talking about?
Seems like a good excuse to someone who doesn’t know what they’re doing and needs an excuse because why they haven’t completed it yet?
The whole post is complete bs in multiple ways. So weird.
It sounds like Hollywood tech lingo. Like when you’re watching a movie or a TV show and the designated techy character starts just saying computer words that make no actual sense in the real world, but I guess in CSI: Idiottown the hard drives have severe overheating issues.
If you work for a boss that fundamentally misunderstands what you are doing, then misleading them into thinking you’re ‘hard at work, making decisions with consequences’ is the theatre you put up to keep the cash flowing.
It’s one of the fundamental flows of autocracy, people try and represent what you want them to
Some interesting facts about excel I learned the hard way.
- It only supports about a million or so rows
- It completely screws up numbers if the column is a number and the number is over 15 digits long.
Not really related to what you said, but I’m still sore about the bad data import that caused me days of work to clean up.
It completely screws up numbers if the column is a number and the number is over 15 digits long.
I work in insurance in Brazil, by standards of our regulatory body, claims numbers must be a string of 20 numbers (zfill(20) if needed). You can’t imagine the amount of times excel had fucked me up rounding down the claim numbers, this is one of the first things I teach to my interns and juniors when they’re working with the claims databases.
Could you import the column in as text to preserve it?
The row limitation seems, to me, like an actually-good thing. Excel is for data where you might conceivably scroll up and down looking at it and 1M is definitely beyond the ability of a human even to just skim looking for something different.
An older version of Excel could only handle 64k rows and I had a client who wanted large amounts of data in Excel format. “Oh sorry, it’s a Microsoft limitation,” I was thrilled to say. “I have no choice but to give you a useful summarization of the data instead of 800k rows (each 1000 columns wide) of raw data.”
Some time ago, I heard a story of CS and Econ professors having lunch together. The Econ professor was excited that Excel was going to release a version that blew out the 64k row limit. The CS professor nearly choked on his lunch.
Dependence on Excel has definitely caused bad papers to be published in the Econ space, and has had real world consequences. There was a paper years ago that stated that once a country’s debt gets above 120% of GDP, its economy goes into a death spiral. It was passed around as established fact by the sorts of politicians who justify austerity. Problem was, nobody could reproduce the results. Then an Econ undergrad asked the original author for their Excel spreadsheet, and they found a coding error in the formulas. Once corrected, the conclusion disappeared.
Is this a real post? I can’t seemed to find it on that website “X, formerly known as Twitter.”
Yep, it’s real. It was a reply, so maybe that’s why you’re having trouble finding it. Here’s a nitter link to it.
Thanks. I’ve legit never understood how to navigate Twitter. Both Twitter and Snapchat gave me a good dose of what I imagine my grandmother feels when faced with operating a desktop computer…
some poeple have linked the discussion in other comment threads
IT guy checking in.
The only time I’ve even seen drive temp sensor alarms is on server raid arrays and other similar hard drives/SSDs… Never in my life have I seen one available on a consumer device, nor have I seen any alarm for and drive temp, go off. Out just doesn’t happen.
IMO, this is one of those language barriers where people call their computer chassis (and everything in it) the “hard drive”.
Applying that assumption, their updated statement is: His computer over heated.
Idk what kind of shit system he’s running on that 60k rows would cause overheating, but ok.
As another IT guy here, it could also be a shitty method of analysis that he got from ChaptGPT. As an amateur coder/script writer, the kinds of code I’ve seen people use from these bots is disturbing. One of my coworkers asked me for help after trying to cobble together something from bots. There were variables declared and never used, variables that were never assigned values but that were used in expressions… it was like it attempted to do that ransom note made from magazine letters but they couldn’t spell coherently.
I will now attempt a full comment … brace your hard drives
Bro seriosuly fuck off my phone is overheating now. Thanks
does elon only hire chip from sales guy vs web dude or something
No he also hire people who created a script to make fake ballots with a bias.
https://bsky.app/profile/denisedwheeler.bsky.social/post/3lhowh3ijgs2f
Hard drive? How old is his computer?
I bet a million bucks the harddrive didnt “overheat”.
Its just someone who doesnt know anything about computer hardware.
Its like me saying my car overheated if there is smoke coming out of it. I know nothing about cars.
I’ve found a lot of people call the computer itself the “hard drive”.
Yeah… That’s what I think the idiot is likely doing.Anyone doing so has no fucking business touching code.Just read that the fuckstick is copying government data onto an external.
I didn’t know hard drive overheating was a thing. Should I be worried that my 5 year old hard drive is about to overheat. I mean is this actually a floppy disk or something?
Removed by mod
When an HDD works continuously it can heat up to above 60 °C if proper air circulation is not allowed, which can cause a very premature failure. In fact, it should be kept under 40 °C to achieve the intended lifespan. Unfortunately, PC cases are usually not great at removing heat from the HDD by default.
As for your drive, it most likely has a temperature sensor so it can be displayed by various utilities.
I have a 12v fan running at 5v spitting air on my hdds, and that’s enough for them to go from 55°C to 29°C, lol.
I did that too, the tiny fan is pretty much silent at 5V. The HDD has so much surface area it only needs a little air circulation.
it is, in the select event that your platter bearing fails, in which case it would be very, very obvious.
So you’ve had this happen?
no. but generally spinning things that spin at several thousands of RPM that are spinning on a bearing, that no longer have a bearing usually sort of uh, tend to be VERY noisy.
Ok, but do you know anyone this has happened to? I don’t and I have some pretty old drives I still use. I tend to just buy more. Also most drives these days are solid state aren’t they? This just feels like a low probability event to me. Overheating RAM or the CPU or GPU, sure, but hard drive?
I had it happen to a random hard drive I bought, old bastard found in a bin at a local thrift store. Anyways had a big dent in it and while it started up, even booting into windows XP it cooked itself made a screeching noise and was hot to the touch. Don’t think I need to explain that the big dent was probably the source of the overheating, anyways had to use an oven mitt to relocate it to a metal bucket of water where it boiled for a minute.
So the story is plausible then?
not personally, i may have seen a video or two of it happening, but it’s hard to tell whether the head is dragging against the platter, or it’s the bearing, either one of those makes horrendous noise.
If you’re worried about it happening on a drive you own, you should copy that data somewhere else as a backup, ideally sooner rather than later. If you’re curious about the health of the drive you do stuff like SMART tests as well.
Yeah, most drives are solid state now, unless you’re buying hdds for archival purposes, still cheaper and denser in most cases. It’s a low probability failure, until the drive meets EOL, in which case it’s a mechanical wear part, either the motor or the bearing fails. One of them will fail first, probably the bearing.
The bearing failing would likely result in the HDD overheating as a result. Assuming the platter still spins, but that’s the only scenario i can think of where that would happen, unless you dump a very specific amount of continuous current into the read arm coils. That might also cause it, but it’s not likely at all.
An ssd “overheating” is more likely, but it shouldn’t cause too many issues, maybe premature degradation over long term use, and slowing of read/write speeds, or in some cases, an improvement, but other than that it should be business as normal. You would have to hit it with like a heat gun, to get a hardware failure or something like that.
I’m not actually worried about my drives. In fact that was kind of the point. I was kidding around because this excuse that the hard drive overheated sounds a little like a car running out of blinker fluid.
Removed by mod
lol guys I think this is a shit post
They even doubled down: https://xcancel.com/DataRepublican/status/1900565922831618202#m
Well thanks for trying to keep us from catching it I guess
thank god, i am going to be ok, i was worried it might be contagious (it’s not, he just has brain damage)
Can you screenshot or something? I can’t load that link
Does this one work? https://nitter.net/DataRepublican/status/1900565922831618202#m Its a bit too long to screenshot.
That works, thanks
So it was a probably shitty external HD… that’s a whole other can of worms
my hard drive overheated
So, this means they either have a local copy on disk of whatever database they’re querying, or they’re dumping a remote db to disk at some point before/during/after their query, right?
Either way, I have just one question - why?
My one question would be “How?”
What the hell are you doing that your hard drives are overheating? How do you even know it’s overheating as I’m like 90% certain hard drives (except NVMe if we’re being liberal with the meaning of hard drive) don’t even have temperature sensors?
The only conclusion I can come to is that everything he’s saying is just bullshit.
Hard drives do get hot and need some cooling but not at 60k rows. Its either made up or their computer case is made of thermal cladding
Imo if they can’t max out their harddrive for at least 24 hours without it breaking, their computer was already broken. They just didn’t know it yet.
Any reasonable SSD would just throttle if it was getting too hot, and I’ve never heard of a HDD overheating on its own, only if there’s some external heat sources, like running it in a 60°C room
You could query 60,000 rows on a low tier smart phone. Makes no sense at all.
Can we think of any device someone might have that would struggle with 60k? Certainly an ESP32 chip could handle it fine, so most IoT devices would work…
Unless the database was designed by someone who only knows of data as that robot from Star Trek, most would be absolutely fine with 60k rows. I wouldn’t be surprised if the machine they’re using caches that much in RAM alone.
Right? There’s no part of that xeet that makes any real sense coming from a “data engineer.”
Terrifying, really.
They have temp sensors. But have never heard of a overheating drive.
I’d much sooner assume that they’re just fucking stupid and talking out of their ass tbh.
Same as Elon when he confidently told off engineers during his takeover of Twitter or gestures broadly at the Mr, Dunning Kruger himself
Wonder if it’s an SQL DB
Elon probably hired confident right wingers whose parents bought and paid their way through prestigious schools rather. If he hired anyone truly skilled and knowledgeable, they’d call him out on his bullshit. So the people gutting government programs and passing around private data like candy are just confidently incorrect
Or they’re doing it on a Diamondmax 9.
Why? Because they feel the need to have local copies of sensitive financial information because… You know… They are computer security experts.
Even if it was local, a raspberry pi can handle a query that size.
Edit - honestly, it reeks of a knowledge level that calls the entire PC a “hard drive”.
Unless they actually mean the hard drive, and not the computer. I’ve definitely had a cheap enclosure overheat and drop out on me before when trying to seek the drive a bunch, although it’s more likely the enclosure’s own electronics overheating. Unless their query was rubbish, a simple database scan/search like that should be fast, and not demanding in the slightest. Doubly so if it’s dedicated, and not using some embedded thing like SQLite. A few dozen thousand queries should be basically nothing.
Yeah, no matter what way you disorganize 60,000 rows, the data is still going to read into memory once.
Have you ever heard of case of overheating hard drives within the last decade?
Plus, 60k is nothing. One of our customers had a database that was over 3M records before it got some maintenance. No issue with overheating lol
Pretty sure I run updates or inserts that count over 60k fairly often. No overheats. Select queries sometimes way higher.
I run queries throughout the day that can return 8 million+ rows easily. Granted, it takes few minutes to run, but it has never caused a single issue with overheating even on slim pc’s.
This makes no fucking sense. 60k rows would return in a flash even on shitty hardware. And if it taxes anything, it’s gonna be the ram or cpu- not the hard drive.
In my experience, the only time that I’ve taxed a drive when doing a database query is either when dumping it, or with SQLite’s vacuum, which copies the whole thing.
For a pretty simple search like OP seems to be doing, the indices should have taken care of basically all the heavy lifting.
I literally work with ~750,000 line exports on the daily on my little Lenovo workbook. It gets a little cranky, especially if I have a few of those big ones open, but I have yet to witness my hard drive melting down over it. I’m not doing anything special, and I have the exact same business-economy tier setup 95% of our business uses. While I’m doing this, that little champion is also driving 4 large monitors because I’m actual scum like that. Still no hardware meltdowns after 3 years, but I’ll admit the cat likes how warm it gets.
750k lines is just for the branch specific item preferences table for one of our smaller business streams, too - FORGET what our sales record tables would look like, let alone the whole database! And when we’re talking about the entirety of the social security database, which should contain at least one line each in a table somewhere for most of the hundreds of millions of people currently living in the US, PLUS any historical records for dead people??
Your hard drive melting after 60k lines, plus the attitude that 60k lines is a lot for a major database, speaks to GLARING IT incompetence.
Reminds me of those 90s ads about hackers making your pc explode.
Musk gonna roll up in a wheelchair, “the attempt on my life has left me ketamine addicted and all knowing and powerful.”
I don’t think I’ve seen a brand new computer in the past decade that even had a mechanical hard drive at all unless it was purpose-built for storing multiple terabytes, and 60K rows wouldn’t even take multiple gigabytes.
You’ve got it all wrong, in traditional computer terminology the “hard drive” is the box that sits under the desk that collects cat fluff and cigarette tar.
/s …?
From the same group that doesn’t understand joins and thinks nobody uses SQL this is hardly surprising .
Probably got an LLM running locally and asking it to get data which is then running 10 level deep sub queries to achieve what 2 inner joins would in a fraction of the time.
They don’t understand joins? How…
You’re giving this person a lot of credit. It’s probably all in the same table and this idiot is probably doing something like a for-loop over an integer range (the length of the table) where it pulls the entire table down every iteration of the loop, dumps it to a local file, and then uses plain text search or some really bad regex’s to find the data they’re looking for.
I have to admit I still have some legacy code that does that.
Then I found pandas. Life changed for the better.
Now I have lots if old code that I’ll update, “one day”.
However, even my old code, terrible as it is, does not overheat anything, and can process massively larger sets of data than 60,000 rows without any issue except poor efficiency.
I think you’re still giving them too much credit with the for loop and regex and everything. I’m thinking they exported something to Excel, got 60k rows, then tried to add a lookup formula to them. Since you know, they don’t use SQL. I’ve done ridiculous things like that in Excel, and it can get so busy that it slows down your whole computer, which I can imagine someone could interpret as their “hard drive overheating”.
Considering that is nearly exactly some of the answers I’ve received during the technical part of interviews for jr data eng, you’re probably not far off.
Shit I’ve seen solutions done up that look like that, fighting the optimiser every step (amongst other things)
You’re not supposed to place your laptop directly in the lap of your fur suit. Always leave an air gap for ventilation, smh.