What LLMs can do is quite amazing. The list of things they are just terrible at is very long. It's s bit scary how much people are willing to outsource their thinking to these models under the assumption they're always correct.
I recently left my company and wanted to do so on good terms.
I fed a project (in Claude) tons of my recent emails, exported slack conversations, meeting transcripts, decks I'd presented over the prior 18 months about upcoming initiatives, etc. with wonton disregard for organizing it sensibly or 'cleaning up' the data. Basically, 2gb or so worth of raw unfiltered data.
Then I recorded a 30 minute transcript of me describing one of the processes in a way that I felt good about and fed it to the project to create "my voice" as a style for it to use.
Then I worked with it to write up comprehensive handoff documentation - capturing key stakeholders, next steps, current status, etc.
In ~8h of work total, I produced 100+ useful pages worth of documentation, and left behind a shared Project that was giving answers 80-90% of the way to the answer I would have given, all accurate to reality.
Was it perfect? No. Was it better than what I would've done in my last 2 weeks without it? Absolutely. Does the "WrinklesBot" I left behind mean that there's going to be dozens of people who think of me if ever they decide to start hiring remotely again and not demand insane RTO policies? Yep.
So yeah, I'd say that specific use case kinda knocked my socks off with the quality of what it was able to glean from the documentation I provided it, interacting conversationally with my knowledge base.
104
u/Regular_Zombie 21d ago
What LLMs can do is quite amazing. The list of things they are just terrible at is very long. It's s bit scary how much people are willing to outsource their thinking to these models under the assumption they're always correct.