“Second Amendment solutions” are only OK to talk about if you’re a Republican (I.e. “Real American”).
I’m being sarcastic, for the record. Back during his first term, Trump talked about “second amendment people” doing something about liberal Supreme Court justices (iirc) and the right wing media treated everyone as crazy for thinking that was wildly inappropriate.
It's really interesting how the same propaganda is applied by fascist governments everywhere. The ones supporting the "nationalist" government are the patriots and the others are enemies
Do you happen to know if ES was the only storage? Its been almost 8 years, but if I was building a log storage and analysis system, then I'd push the logs to S3 or some other object store and build an ES index off of that S3 data. From the consumer's perspective, it may look like we're using ES to store the data, but we have a durable backup to regenerate ES if necessary.
Searchable snapshots in Elasticsearch can be backed by S3 and they perform very well. No need to store the data on hot nodes any longer than it takes for the index to do a rollover, and from then it's all S3.
> I really never understood how people could store very important information in ES like it was a database.
I agree.
Its been a while since I touched it, but as far as I can remember ES has never pretended to be your primary store of information. It was mostly juniors that reached for it for transaction processing, and I had to disabuse them of the notion that it was fit for purpose there.
ES is for building a searchable replica of your data. Every ES deployment I made or consulted sourced its data from some other durable store, and the only thing that wrote to it were replication processes or backfills.
What engine and data format were you using for your experiment?
You mention parquet and spark, but I’m wondering if you tried any of the “Lakehouse” formats that are basically parquet + a metadata layer (ie iceberg). I’d probably at least give Trino or Presto a shot, although I suspect that you’ll have similar metadata issues with those engines.
Yeah but everyone involved in the LLM space is encouraging you to just slurp all your data into these things uncritically. So the comparison to eval would be everyone telling you to just eval everything for 10x productivity gains, and then when you get exploited those same people turn around and say “obviously you shouldn’t be putting everything into eval, skill issue!”
Yes, because the upside is so high. Exploits are uncommon, at this stage, so until we see companies destroyed or many lives ruined, people will accept the risk.
This administration has not been operating the DoJ in good faith. One only has to look at the buffoonish attempts to push through charges on Comey, James and other political opponents to see that.
Treating the investigation in good faith is not being neutral or unbiased. Expecting more of the same is.
Because it is very clear to most people - you excepted, apparently - that this is not a normal case but one that is solely predicated on putting pressure on someone who is not acting on Donald Trump's whim but based on their job description. If Powell would have reduced the interest rates further this would have never happened.
The DOJ is now weaponized as a political tool, rather than that it is used for its real purpose. If you refuse to see this that's on you, not even on Donald Trump. The FED is independent for a reason, you are seeing that mechanism in action and so far no US president has every made a move like this.
There’s no question about the independence of the DoJ. Its independence is undeniably gone and it is full on working as Trump’s enforcement arm. Anyone who tries to argue otherwise is a clown.
Case in point, you’d think by how things are reported that Trump brought down inflation. But inflation was down when Biden left office and Trump has done nothing to improve it.
#2 is happening a lot more than people think. It’s incredibly hard to quantify tech debt in software and so as a result productivity measurements are pretty inaccurate. Even without AI there is a trend of devs writing a barely working system and then throwing it over the wall to “maintenance programmers”. Said devs are often rated highly by management as being productive compared to the “maintenance devs,” but all they really did was make other people deal with their garbage. I’ve seen these sorts of systems take months to years to be production ready while the original dev is already off to their new gig (and maybe cluelessly bragging on HN about how much better they are than the people cleaning up their mess).
To get an accurate productivity metric you’d have to somehow quantify the debt and “interest” vs some alternative. I don’t think that’s possible to do, so we’re probably just going to keep digging deeper.
I’m being sarcastic, for the record. Back during his first term, Trump talked about “second amendment people” doing something about liberal Supreme Court justices (iirc) and the right wing media treated everyone as crazy for thinking that was wildly inappropriate.
reply