Files
llm-arch-research/assets/models/gpt1.svg

1 line
30 KiB
XML
Raw Normal View History

<svg xmlns="http://www.w3.org/2000/svg" style="background: transparent; background-color: transparent;" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="1287px" height="162px" viewBox="-0.5 -0.5 1287 162" content="&lt;mxfile&gt;&lt;diagram name=&quot;GPT Architecture&quot; id=&quot;DEYydPS-O6mnllJWumln&quot;&gt;3Vtbb6M4GP01eRwL37B5nOll52FnVKkr7cwjDU6CSnBEaJPur18TTDDYuUBI0gmVKP6wMT4+Pt9nm4zw3Xz9VxYuZj9kJJIR8qL1CN+PEIIYB+pfYfkoLZjB0jDN4khnqg3P8X9CGz1tfYsjsWxkzKVM8njRNI5lmopx3rCFWSZXzWwTmTRrXYRTYRmex2FiW/+No3xWWjlitf27iKezqmbo6wbPwyqzbslyFkZyZZjwwwjfZVLm5dV8fSeSArwKl7Lc44672xfLRJofUwCXBd7D5E23Tb9X/lE1NpNvaSSK/N4If1vN4lw8L8JxcXelulfZZvk8USmoLidxktzJRGabsngymaDxWNl1NSLLxXrnq8ItAIo5Qs5Fnn2oLLoA4hqzijRYp1d1FxCibTMTfl8bQ93t0+2za2TUhQbHDRRxAOUnqoZvUfyuLqfF5Y9w+aqQ0jfUI817b4qfI/Ttuwi3OV6y6u7XPFcwxDI9Df5lnslXYXSAP+biZWJ3TBQKPjm6Y/DejqEQEMSYT6lfnhvdRO1eYhwEjGDK9ZnbfTZEl1Vc3kduEamBrZOpTEUTzjJ7kWc/NOqR8i0b61zUjVYmkjCP35uPcrVPF32SsapkizKmTfrzFkJ5mE1Frgu1QNq+xVG4UQu2R1Gz2qD0o8xWYbaD7478P0W+ktnrrvyDEj/wGQ59m/gCRlSwYYivWAoC6hPoofJ8kPgQBAh7zNfn8/CeWf33U2bz0/AdAC3MAhAEzIeBR4pzAyzfBgszwBkkiFN9ttEiQ6gE7CgKYh3nv4zr3wWCgOrU/VoDukl8VIlUvdUvM2GUKpJ1sU2qKtdPgKAmYikJw4jSsXBWdX829kHGgEkmSA7xj6jBWjJVn+l5CAiPiMFEGn0t4laVGifhchmP3Zz0unDSYLlIXuTqoTb0JB62eUfcvWLgTB0hW2U70WeitssEnnHA1vPKllge1H4qCgBFmHtBdW7U8oWezTNDVxTakyqd5MugiszymZzKNExO5wvkNmFKAbkWYyCloHY6jPhNmdi4sPrgwR/HIO5gkB17qUJqLi0OK3O4XJQT7Em8LtR8EKmmxTg1tbrZB9SSauia9Q0hzcFnHW+XDSiIY5jyqwo7xMAYPZg3BxBpd/6xAxMSc/irM+/iQIYbpsesyxwk3pYiNSt+m/dOpojJhys7euwDI7RD3G/1Wz86YBIAIwAkLTbQo7pfdVL4YWRbFBmW+9viMyP0pI1aoZ6f7/QtAQKmZ8HdimO6N7+6KNvTm9kuB9Rp/tVPwlwaxtyUHXxO5Fw8/GROF2+cbk11xq7ldB3rT59c+67rCzEBGFHKIQ4oJpzjZsjaV/uKKGyfKzyP+KnGIMopV+Ag5nPaXCWC2Nv7zlyF576SaYZ84jOMeKfSsC19zfwnSx/2Oypdn9DxCAZXC17mxB3ZrN6hF4OrY1X3AXU8aRuKFn+FXaa5YS8P577J5hhm4wqS5jKEa+MKOtV0iNVgbIeS/6i2psr0MH85DeYzbTcdgrM5TDFhwOWdHIASBOgAiNru/Eku43L37gygDrOV0Q1U4uLo+SAlXaWxp8wxW+aI5wZmeJ2z92XuxVhGItvDF9hZ6xQneERcPOLoBQ+laewITWNnkzR+AUd6xhUWBzMdxMSXmp4QdnNwVuxsDPQdKxTD4+nd0EDn1xzoJLg9Zlbfq5nMRJdiJrwhZqpw5IrUrLZsbomajkkgvVR0VFV+G9SE16QmuUR41JNijlVYsgPL4Slmz9uA4ys1cPT3bDtznkLYAegXtH02s9mHHexrLxX20kVsNf9P10XqCCbppUhL7WDy7zgV4bCyeOUFMmTJpb2g41pBh+0PJXohbAdFz3KSz8P1oBBvV2t2r+8MAmVr6/OyUNoKu1lrXF5dEulhRfQdqARDgEK7KmKlbl884CHakjjMD4jcJvUksli9qcgM+byMi6enTrPdmzMBAqy1RAkJ8P2AQEYYZaj6BKT7Jx9e67EUqHCtPkjzub0/8lDJ+nc9Zfb611H44X8=&lt;/diagram&gt;&lt;/mxfile&gt;"><defs/><g><g><rect x="230" y="0" width="440" height="160" fill="#fff2cc" stroke="#000000" pointer-events="all" style="fill: light-dark(rgb(255, 242, 204), rgb(40, 29, 0)); stroke: light-dark(rgb(0, 0, 0), rgb(255, 255, 255));"/></g><g><rect x="281.43" y="50" width="78.97" height="60" fill="#dae8fc" stroke="#6c8ebf" pointer-events="all" style="fill: light-dark(rgb(218, 232, 252), rgb(29, 41, 59)); stroke: light-dark(rgb(108, 142, 191), rgb(92, 121, 163));"/></g><g><g transform="translate(-0.5 -0.5)"><switch><foreignObject style="overflow: visible; text-align: left;" pointer-events="none" width="100%" height="100%" requiredFeatures="http://www.w3.org/TR/SVG11/feature#Extensibility"><div xmlns="http://www.w3.org/1999/xhtml" style="display: flex; align-items: unsafe center; justify-content: unsafe center; width: 77px; height: 1px; padding-top: 80px; margin-left: 282px;"><div style="box-sizing: border-box; font-size: 0; text-align: center; color: #000000; "><div style="display: inline-block; font-size: 12px; font-family: &quot;Helvetica&quot;; color: light-dark(#000000, #ffffff); line-height: 1.2; pointer-events: all; white-space: normal; word-wrap: normal; "><div>Masked</div>Multi+Head<br />Attention</div></div></div></foreignObject><text x="321" y="84" fill="light-dark(#000000, #ffffff)" font-family="&quot;Helvetica&quot;" font-size="12px" text-anchor="middle">MaskedMulti+H...</text></switch></g></g><g><path d="M 562.88 80 L 573.63 80" fill="none" stroke="#000000" stroke-miterlimit="10" pointer-events="stroke" style="stroke: light-dark(rgb(0, 0, 0), rgb(255, 255, 255));"/><path d="M 578.88 80 L 571.88 83.5 L 573.63 80 L 571.88 76.5 Z" fill="#000000" stroke="#000000" stroke-miterlimit=