Published on February 28, 2024 under the Coding category. Toggle Memex mode My knowledge of programming has been largely self-directed. When I get excited about an idea, I research what I need to do to solve that problem. For example, when I was interested in how search engines work, I learned about the computational efficiency of sets. I discovered the problem "how can I check if I have crawled this URL?" when I may have crawled thousands of URLs. To answer this question faster, I used a set, w...