Hacker Newsnew | past | comments | ask | show | jobs | submit | bawis's commentslogin

What body of knowledge (books, tutorials etc) did you use while developing it?

Before I started the project, I was already vaguely familiar with the notion of an inverted index [1]. That small bit of knowledge meant that I knew where to start looking for more information and saved me a ton of time. Inverted indices form the bulk of many search engines, with the big unknown being how you implement it. I just had to find an adequate data structure for my application.

To figure that out, I remember searching for articles on how to implement inverted indices. Once I had a list of candidate strategies and data structures, I used Wikipedia supplemented by some textbooks like Skiena's [2] and occasionally some (somewhat outdated) information from NIST [3]. I found Wikipedia quite detailed for all of the data structures for this problem, so it was pretty easy to compare the tradeoffs between different design choices here. I originally wanted to implement the inverted index as a hash table but decided to use a trie because it makes wildcard search easier to implement.

After I developed most of the backend, I looked for books on "information retrieval" in general. I found a history book (Bourne and Hahn 2003) on the development of these kind of search systems [4]. I read some portions of this book, and that helped confirm many of the design choices that I made. I actually was just doing what people traditionally did when they first built these systems in the 1960s and 1970s, albeit with more modern tools and much more information on hand.

The harder part of this project for me was writing the interpreter. I actually found YouTube videos on how to write recursive descent parsers to be the most helpful there, particular this one [5]. Textbooks were too theoretical and not concrete enough, though Crafting Interpreters was sometimes helpful [6].

[1] https://en.wikipedia.org/wiki/Inverted_index

[2] https://doi.org/10.1007/978-3-030-54256-6

[3] https://xlinux.nist.gov/dads/

[4] https://doi.org/10.7551/mitpress/3543.001.0001

[5] https://www.youtube.com/watch?v=SToUyjAsaFk

[6] https://craftinginterpreters.com/


Thanks for detailing, how much time you invested in it?

I spent around 170 hours on this so far, with only 60% of that being coding. The rest was mostly research or writing.


> Language learning: I have a couple of languages that I want to focus on this 2026. Both for the enjoyment of learning and using said languages, and also because it will help me improve work-wise.

May I ask which languages are you talking about here? and what methods you will follow?


Sorry, human languages. Progress in my Italian and start learning some of the other more complex languages such as Russian and/or Arabic.

I will try to make the learning process as natural as possible. Italian I already have a base and my native language is similar, so the learning process will be based on immersion and grammar learning. For the other ones, I will try to get a more structured learning path such as courses or programs to get to learn as fast and simple as possible.


For complex analysis, I recommend using Stein's book (the whole series is good).


Visualizing Complex Analysis by Tristan Needham is another good one IMO


Same with English. let's ~~bomb other countries~~ spread "democracy".


Learn British English, get an urge for a cup of tea.


The old problem with metrics like GDP, is that they consider the whole but not the parts, it is kinda saying that I and Musk have billions in wealth, but I am in debt.


The new problem with GDP is we can no longer trust government numbers.

1 - https://www.pbs.org/newshour/politics/trump-seeks-to-fire-bu...


> The old problem with metrics like GDP, is that they consider the whole but not the parts, it is kinda saying that I and Musk have billions in wealth, but I am in debt.

Does this mean you also think that "the (US) economy is tanking" OR do you agree with me that the economy is NOT tanking?


He saying that using a single metric like GDP isn't sufficient for claiming that the economy isn't tanking. The economy != GDP. For many regular people, it's terrible right now.


See my other comments in this thread that surfaces other metrics like: debt burden ratios, repayment behavior, GDP per person at market exchange rates, Adjusted for price differences, and Adjusted for prices and hours worked.

I'm not saying that Americans aren't under more economic strain than a few years ago (pre-pandemic), excluding 2007 - 2008.

However, I think if someone is going to claim the economy is tanking OR that Americans are fast becoming destitute or something extreme like that, you gotta give some quantitative data to back up that claim.


Those metrics are all aggregate ones. A group containing Bill Gates plus one destitute homeless person $1M in debt has great metrics of that sort. Total debt is a tiny fraction of total income. Income per person is huge, and doesn't stop being huge when you adjust for price differences or hours worked or anything else you care to adjust for. But that destitute homeless person with a $1M debt is still destitute and homeless and $1M in debt.

I haven't commented on "repayment behaviour" because your other comments don't actually mention that. Maybe there's something behind one of the links you posted that explains what you mean by it. I did have a quick look at the not-paywalled ones and didn't see anything of the kind.

(The above isn't a claim that actually the US economy is in a very real sense tanking, or that not-very-rich Americans are heading for destitution, or anything else so concrete. Just pointing out why the things you've been posting don't seem like they address the objection being made.)


I will take the Warren Buffett prediction seriously.


> we haven't really had time to take a breath and understand what's going on.

The field of Explainable AI (or other equivalent names, interpretable AI, transparent AI etc) is looking for talent, both in academia and industry.


That book doesn't really teach the tricks of the trade (and it is not promised anyway), but it is a good introduction to the world of memory for people unaware of the potential of memory.


Upon reading "Weapons of Math Destruction" I came across this term, as a non American this weirdly struck me.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: