All public logs

Combined display of all available logs of Catcliffe Development. You can narrow down the view by selecting a log type, the username (case-sensitive), or the affected page (also case-sensitive).

• 11:15, 9 August 2024 XenoEngineer talk contribs created page Llama attention extension (Created page with "Category:Llama3.1 Category:AI Category:Python __NOTOC__ <div style="background-color:azure; border:1px outset azure; padding:0 20px; max-width:860px; margin:0 auto; "> = Programmatic Extension of Infini-Attention Feature = == Modifying Positional Encoding == To extend the context-length of LLama 3.1's inherent infini-attention mechanism, start by modifying its positional encoding vector.   A good place to begin is by increasing the frequency of the s...")