Blog
Articles on AI workflows, MCP patterns, and what we have learned building Synapse.
Why Transformers Can't Tell Position Apart — and How RoPE Fixes It
Self-attention is blind to order. Shuffle the words in a sentence and you get identical attention scores. Positional embeddings solve this — but the way they do it determines whether your model can handle long contexts at inference time.
Stay in the loop
Synapse is your AI systems mentor.
It asks the kind of questions senior engineers do, sketches diagrams with you, and forces you to defend every architectural choice so your ideas are ready for interviews or production reviews.