{"entities":{"Q6972316":{"pageid":21336951,"ns":120,"title":"Item:Q6972316","lastrevid":84044093,"modified":"2026-05-08T16:53:29Z","type":"item","id":"Q6972316","labels":{"en":{"language":"en","value":"Geometry of linear neural networks: equivariance and invariance under permutation groups"}},"descriptions":{"en":{"language":"en","value":"scientific article; zbMATH DE number 8052175"}},"aliases":{},"claims":{"P31":[{"mainsnak":{"snaktype":"value","property":"P31","hash":"fd5912e4dab4b881a8eb0eb27e7893fef55176ad","datavalue":{"value":{"entity-type":"item","numeric-id":56887,"id":"Q56887"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$67450421-DC5F-4277-A02A-9C3EBEE680C0","rank":"normal"}],"P159":[{"mainsnak":{"snaktype":"value","property":"P159","hash":"6fd977e294a0d1e3f1a916366108ff7a731b5b31","datavalue":{"value":{"text":"Geometry of linear neural networks: equivariance and invariance under permutation groups","language":"en"},"type":"monolingualtext"},"datatype":"monolingualtext"},"type":"statement","id":"Q6972316$A421BC19-6D7B-4B74-8EFF-DDB309FD8BCF","rank":"normal"}],"P225":[{"mainsnak":{"snaktype":"value","property":"P225","hash":"5bc928b3fab61da432439425b38281a639378357","datavalue":{"value":"1568.14094","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q6972316$8D60243F-CE85-406C-BA58-9248BCCC41D3","rank":"normal"}],"P27":[{"mainsnak":{"snaktype":"value","property":"P27","hash":"c958b1004a3f7003d668ceb6d10555c7dd3cd154","datavalue":{"value":"10.1137/24M166053X","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q6972316$976827AD-7004-4C7C-880C-8AF9DA01AD2D","rank":"normal"}],"P16":[{"mainsnak":{"snaktype":"value","property":"P16","hash":"c7f1aab27c1e76a307c3f97682ef382d821ef59e","datavalue":{"value":{"entity-type":"item","numeric-id":1696174,"id":"Q1696174"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$EC0D1F1F-4CD8-4EB4-A732-5CD25ECF5648","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"f913f5b22c8ff02d597e1e01ef10c33178910c24","datavalue":{"value":{"entity-type":"item","numeric-id":2028008,"id":"Q2028008"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$F5B6D052-E6EB-4973-B903-A31C890EDF37","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"47956940edbec45cca3e4b0c23b1588e60ce35de","datavalue":{"value":{"entity-type":"item","numeric-id":6509616,"id":"Q6509616"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$783D6AB5-E69F-48AF-B3AC-9E87EBA0A4EE","rank":"normal"}],"P200":[{"mainsnak":{"snaktype":"value","property":"P200","hash":"adf8a0bd51238b524fba34bfeeffbcee4a2743c2","datavalue":{"value":{"entity-type":"item","numeric-id":71521,"id":"Q71521"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$0E39128F-1D95-4FE8-BB93-1B079CF9ED1F","rank":"normal"}],"P28":[{"mainsnak":{"snaktype":"value","property":"P28","hash":"5b6ce029e67be4d5292b15764d5ee8d09506ed67","datavalue":{"value":{"time":"+2025-06-12T00:00:00Z","timezone":0,"before":0,"after":0,"precision":11,"calendarmodel":"http://www.wikidata.org/entity/Q1985727"},"type":"time"},"datatype":"time"},"type":"statement","id":"Q6972316$A7273DCF-ADCF-45D7-AE8C-F4D103321684","rank":"normal"}],"P1448":[{"mainsnak":{"snaktype":"value","property":"P1448","hash":"6798a83d8c0baf2573d84634f46eba45340f54b9","datavalue":{"value":"Understanding the geometry of the function space of a neural network architecture is a fundamental task in the theory of deep learning. Here, the authors specialize to the case of linear networks -- neural networks built as a composition of linear functions -- to study invariance and equivariance properties under a group action.\\N\\NFormally, a linear neural network represents a linear function of bounded rank, and therefore gives a point on the determinantal variety \\(\\mathcal{M}_{r,m\\times n}\\) of \\(m \\times n\\) matrices with rank at most \\(r\\). If \\(G \\leq S_n\\) is a subgroup of the permutation group, then the set of \\(G\\)-invariant linear functions \\(\\mathcal{I}_{r,m\\times n}^G\\) is an irreducible subvariety of \\(\\mathcal{M}_{r,m\\times n}\\) and the authors compute its dimension, degree, and singular locus. The case of equivariant functions is more subtle, and the authors describe the irreducible components of the set of \\(G\\)-equivariant functions \\(\\mathcal{E}^G_{r,n \\times n}\\) for cyclic subgroups \\(G = \\langle \\sigma \\rangle \\leq S_n\\). These irreducible components are indexed by integer vectors \\(\\mathbf{r}\\) corresponding to certain partitions of the rank \\(r\\) (Theorem 4.2). For each irreducible component \\(\\mathcal{E}^{G,\\mathbf{r}}_{r,n\\times n}(\\mathbb{C}) \\subseteq \\mathcal{E}^{G}_{r,n\\times n}(\\mathbb{C})\\), the authors compute the dimension, degree, and singular locus, as well as the real dimension and singular locus of \\(\\mathcal{E}^{G,\\mathbf{r}}_{r,n\\times n}(\\mathbb{R})\\). As a final consideration, the authors compute the squared error degree of these subvarieties of \\(\\mathcal{M}_{r,m\\times n}\\), defined as the number of complex critical points on the variety of the function \\(M \\mapsto \\|MX - Y\\|^2_F\\) for generic data matrices \\(X\\) and \\(Y\\). The authors connect these results to the design of neural networks by describing weight sharing strategies which yield networks describing \\(\\mathcal{I}^G_{r,m\\times n}\\) or an irreducible component of \\(\\mathcal{E}^{G}_{r, n \\times n}\\).\\N\\NThe theory developed by the authors is accompanied by helpful small-scale examples as well as numerical experiments. The numerical experiments provide evidence that the substantial computational benefit obtained by imposing equivariance on the network architecture does not lead to a substantial loss in model accuracy.","type":"string"},"datatype":"string"},"type":"statement","id":"Q6972316$F9502BAA-8785-49A6-A043-CAD38BD0F5BD","rank":"normal"}],"P1447":[{"mainsnak":{"snaktype":"value","property":"P1447","hash":"5b9f69251881f75431ecff896e1de8391b3b3aa7","datavalue":{"value":{"entity-type":"item","numeric-id":6451382,"id":"Q6451382"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$1C08EFDD-1FC0-4C75-AB43-9D7E4B5CCC19","rank":"normal"}],"P226":[{"mainsnak":{"snaktype":"value","property":"P226","hash":"83379f5d62f370fcfc0b164263d386315ef7505b","datavalue":{"value":"14M12","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q6972316$BB88ACE9-C563-4542-ADB8-6B646A90C240","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"ba5f7486cfb64f062d1b1d8e48f356198d5bc8e7","datavalue":{"value":"15A03","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q6972316$807E7FEA-8DC7-4007-A734-19345DE10465","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"3a56ed6d195ea3539360546b34a91d2ad94c0346","datavalue":{"value":"15A23","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q6972316$44F71DB4-3C58-4037-A4F1-693784373CE1","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"fa3a0cd38ea582d702916ee49599e832f201d954","datavalue":{"value":"20B30","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q6972316$6D99320B-8222-48BF-9853-649563C6C0A2","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"86ef24f5c9e2aac48660aa2e36054c8246d3fc97","datavalue":{"value":"68T07","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q6972316$C529C55F-501B-4C4F-A01C-E4B97EBDD65E","rank":"normal"}],"P1451":[{"mainsnak":{"snaktype":"value","property":"P1451","hash":"dbaecf94227ae9438f62089abac959e905ee0ea6","datavalue":{"value":"8052175","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q6972316$8EE44D56-57FE-457F-8BB8-AEE60E219F64","rank":"normal"}],"P163":[{"mainsnak":{"snaktype":"value","property":"P163","hash":"45fcd4163b5f33e6e8c784f5522d7246c0a1a61e","datavalue":{"value":{"entity-type":"item","numeric-id":57056,"id":"Q57056"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$B3674A32-591F-4B3D-B2CF-7A01A9C65A0E","rank":"normal"}],"P1450":[{"mainsnak":{"snaktype":"value","property":"P1450","hash":"f1822693751276ffe0b67668e6a3a0a7699fc150","datavalue":{"value":"neuromanifold","type":"string"},"datatype":"string"},"type":"statement","id":"Q6972316$9A884AEB-E6F0-4FFD-9C13-57BF0A4999DC","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"c61500a50b9a89dd5d92a2eb78a924249890a177","datavalue":{"value":"linear neural network","type":"string"},"datatype":"string"},"type":"statement","id":"Q6972316$A55BD3F3-F9BF-4828-B8FA-82373E7E52DB","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"2c3b0d28d50231f783de1fd22a27b61e658c3d4d","datavalue":{"value":"equivariance","type":"string"},"datatype":"string"},"type":"statement","id":"Q6972316$34528D83-9F9B-43D4-B5C1-4275512ED29C","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"362548f48c2cc7292325621017a1a6738a47ebfc","datavalue":{"value":"determinantal variety","type":"string"},"datatype":"string"},"type":"statement","id":"Q6972316$D6FC3388-705C-49E6-9F95-ABFAE2076B73","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"79a7037f988bdcb50accb61a6149c659356f96a3","datavalue":{"value":"squared-error loss","type":"string"},"datatype":"string"},"type":"statement","id":"Q6972316$A5018D95-613D-4461-B498-43FDDE3E8660","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"c2f1ff22d6c0e56cbc383fcf9ccbf7cf918ddec6","datavalue":{"value":"Eckart-Young","type":"string"},"datatype":"string"},"type":"statement","id":"Q6972316$8839F828-6CFC-4448-A777-0964D90BA890","rank":"normal"}],"P1460":[{"mainsnak":{"snaktype":"value","property":"P1460","hash":"57f7fea50d2ce1b39b695c4a1313582eed405e38","datavalue":{"value":{"entity-type":"item","numeric-id":5976449,"id":"Q5976449"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$0D5868E6-00C7-450A-8504-86012AECCE3E","rank":"normal"}],"P223":[{"mainsnak":{"snaktype":"value","property":"P223","hash":"8c9a7a50480c34559dd5866caf08bba46d3d643e","datavalue":{"value":{"entity-type":"item","numeric-id":6150738,"id":"Q6150738"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$070B8424-525C-484D-9A5E-85CB05AA12CC","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"d5512384eb340ae675336c875e37d1bf4f97bc71","datavalue":{"value":{"entity-type":"item","numeric-id":6927790,"id":"Q6927790"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$F921C077-D394-4E87-8B21-9A590A293E5E","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"083690532a2dff8a0b2e4e3b486527ae737ca13c","datavalue":{"value":{"entity-type":"item","numeric-id":5963081,"id":"Q5963081"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$C332B652-CB7A-4549-B996-CF6CD5FCF396","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"2294efbdaf0bfa6b2244a3be9ca31d0355a39f59","datavalue":{"value":{"entity-type":"item","numeric-id":3328651,"id":"Q3328651"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$3792BCE7-138E-4F8D-BDAF-FB4F7CA965C4","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"3ed17d9c11b83e077c08881fd60f2cad56a1a8c0","datavalue":{"value":{"entity-type":"item","numeric-id":4002797,"id":"Q4002797"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$EFD0C873-DF11-418B-AFF1-4448A8C687CA","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"841d367289d34c3c7ccdddbc37228132d1c7136b","datavalue":{"value":{"entity-type":"item","numeric-id":5097687,"id":"Q5097687"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$7BE971D4-0CA7-450A-B09C-FF41D1FC5294","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"dc2c8b6ba7c8c63bb164ca49f05b00aefd74b582","datavalue":{"value":{"entity-type":"item","numeric-id":6562372,"id":"Q6562372"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$10834743-4336-4BF8-8515-E7BE030D611E","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"02ca8d0cafe43886dc43f0cf493f69f682b13a00","datavalue":{"value":{"entity-type":"item","numeric-id":6073079,"id":"Q6073079"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$FAF291E8-F2EC-40C7-A3CA-685B27EA20A8","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"17305849a72ed2a92ed8d21ed09734f958119739","datavalue":{"value":{"entity-type":"item","numeric-id":4336511,"id":"Q4336511"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q6972316$677B190A-4490-4945-BFA1-AFCA2ABBD9AD","rank":"normal"}]},"sitelinks":{"mardi":{"site":"mardi","title":"Geometry of linear neural networks: equivariance and invariance under permutation groups","badges":[],"url":"https://portal.mardi4nfdi.de/wiki/Geometry_of_linear_neural_networks:_equivariance_and_invariance_under_permutation_groups"}}}}}