This is a collection of models and spaces associated with the paper: "Disentangling and Integrating Relational and Sensory Information in Transformer"
Awni Altabaa
awni00
AI & ML interests
neural network architectures, inductive biases, language models, relational learning, reinforcement learning
Organizations
models
7
awni00/T-sa32-1.3B
1B
•
Updated
•
2
awni00/T-sa24-757M
0.8B
•
Updated
•
3
awni00/DAT-sa16-ra16-nr64-ns2048-sh8-nkvh8-1.27B
Text Generation
•
1B
•
Updated
•
1
awni00/DAT-sa16-ra16-nr128-ns2048-sh16-nkvh8-1.27B
Text Generation
•
1B
•
Updated
•
1
awni00/DAT-sa8-ra8-nr32-ns1024-sh8-nkvh4-343M
Text Generation
•
0.3B
•
Updated
awni00/DAT-sa8-ra8-nr64-ns1024-sh8-nkvh4-343M
Text Generation
•
0.3B
•
Updated
•
1
awni00/DAT-sa8-ra8-ns1024-sh8-nkvh4-343M
Text Generation
•
0.3B
•
Updated
•
1
datasets
0
None public yet