sig
Full identifier: https://w3id.org/np/RAszCcnWVTYomkTM0J8K9p0PSp-gwfAIP8oDv_sfGKsdQ#sig
Searching for classes...
Searching for instances...
Searching for templates...
Minted in Nanopublication
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/dc/terms/creator
creator
https://w3id.org/np/RAoSadUw99...
Leshem Choshen π€π€ @ICML wanna talk?
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/spar/cito/agreesWith
agreesWith
https://x.com/RickardGabriels/status/1810368375455207470
status/1810368375455207470
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/spar/cito/agreesWith
agreesWith
https://x.com/pratyusha_PS/status/1739025292805468212
status/1739025292805468212
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/spar/cito/discusses
discusses
https://www.alphaxiv.org/abs/2408.13656
2408.13656
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/spar/cito/discusses
discusses
https://www.alphaxiv.org/pdf/2310.01886
2310.01886
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/spar/cito/discusses
discusses
https://www.alphaxiv.org/pdf/2405.07813
2405.07813
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/spar/cito/discusses
discusses
https://x.com/prateeky2806/status/1727589818618523783
status/1727589818618523783
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/spar/cito/includesQuotationFrom
includesQuotationFrom
https://x.com/RickardGabriels/status/1810368375455207470
status/1810368375455207470
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://purl.org/spar/cito/includesQuotationFrom
includesQuotationFrom
https://x.com/pratyusha_PS/status/1739025292805468212
status/1739025292805468212
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
http://www.w3.org/2000/01/rdf-schema#comment
comment
(this is a literal)
" You only learn a few parameters, with your parameter "efficient" finetuning. The rest isπ©
A whole line of works𧡠shows that by throwing redundancy
we can get better LoRas, keep less memory and of course model merge https://twitter.com/LChoshen/status/1833879920348422216/photo/1
ComPeft shows you can improve LoRAs by pruning aggressively and making the remaining weights binary (+/-)
It also means parameter efficiency still relies on overparametrization(but only during training)
https://x.com/prateeky2806/status/1727589818618523783
Laser shows it on full models
https://x.com/pratyusha_PS/status/1739025292805468212 https://twitter.com/LChoshen/status/1833879922500080084/photo/1
In merging, many find that with only those few weights one can make a "multitask" model, keeping the important ones for each model and switching.
those e.g. 1% of the weights also represent tasks well
Many..
https://www.alphaxiv.org/abs/2408.13656
https://www.alphaxiv.org/pdf/2405.07813
https://www.alphaxiv.org/pdf/2310.01886
Those works are focused on efficient multitask learning that compresses the models, can keep many models and switch between them as necessary.
Another option to compress is to SVD the LORA, separately or
to a shared space, saving the tiny differences
https://x.com/RickardGabriels/status/1810368375455207470
And just because we discussed compression, of course this is all just "model compression" if you want to compress to just save space, there are smarter ways:
https://github.com/zipnn/zipnn
"
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
https://schema.org/keywords
keywords
(this is a literal)
"finetuning"
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
https://schema.org/keywords
keywords
(this is a literal)
"low-rank-adapters"
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
https://schema.org/keywords
keywords
(this is a literal)
"model-compression"
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
https://schema.org/keywords
keywords
(this is a literal)
"multitask-learning"
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
https://schema.org/keywords
keywords
(this is a literal)
"serving-systems"
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
https://sense-nets.xyz/endorses
endorses
https://www.arxiv.org/abs/2407.00066
2407.00066
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
https://sense-nets.xyz/recommends
recommends
https://github.com/zipnn/zipnn
zipnn
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
this assertion
https://sense-nets.xyz/summarizes
summarizes
https://www.arxiv.org/abs/2407.00066
2407.00066
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
The assertion above
http://www.w3.org/ns/prov#linksTo
linksTo
https://x.com/LChoshen/status/1833879920348422216
status/1833879920348422216
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
The assertion above
http://www.w3.org/ns/prov#wasAssociatedWith
wasAssociatedWith
https://x.com/LChoshen
LChoshen
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
The assertion above
http://www.w3.org/ns/prov#wasAttributedTo
wasAttributedTo
https://orcid.org/0000-0002-0085-6496
0000-0002-0085-6496
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
The assertion above
http://www.w3.org/ns/prov#wasAttributedTo
wasAttributedTo
https://w3id.org/np/RAoSadUw99...
Leshem Choshen π€π€ @ICML wanna talk?
.
This is the identifier for the assertion of this nanopublication.
https://w3id.org/np/RAszCcnWVT...#assertion
The assertion above
http://www.w3.org/ns/prov#wasGeneratedBy
wasGeneratedBy
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#activity
activity
.
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#activity
activity
http://www.w3.org/1999/02/22-rdf-syntax-ns#type
type
https://sense-nets.xyz/supervisedActivity
supervisedActivity
.
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#activity
activity
http://www.w3.org/ns/prov#wasAssociatedWith
wasAssociatedWith
https://sense-nets.xyz/
Sensenets
.
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
This nanopublication
http://www.w3.org/2000/01/rdf-schema#label
has the label
(this is a literal)
"CoSMO Semantic Post"
.
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
This nanopublication
http://purl.org/nanopub/x/hasNanopubType
has the type
https://sense-nets.xyz/SemanticPost
SemanticPost
.
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
This nanopublication
date and time when the nanopublication was created
http://purl.org/dc/terms/created
was created on
(this is a literal)
"2024-09-11T18:07:24.837Z"
.
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#sig
sig
http://purl.org/nanopub/x/hasSignatureTarget
has as target
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
this nanopublication
.
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#sig
sig
http://purl.org/nanopub/x/hasAlgorithm
has the algorithm
(this is a literal)
"RSA"
.
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#sig
sig
http://purl.org/nanopub/x/hasPublicKey
has the public key
(this is a literal)
"MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArHtI92jm8pAYVsvJabxLGfOT+7G0JyJGh2gwjB5x2pFPga6wWTd+rNBWWUZViIFnaJrBEsJpgdnoupLU9ppwn+khMiGRfxqGsDDzwHcj3Jc75CRys7d3etwXdBdoXfBgjsJiZBazwm13idr6tljRrC1TaEJBnRQAqzBw9cLDeGY77cSznzXT39feUGT168dpCSE9O6u/48DvvWVqciHGsH9cQ+LroJJVsMrorwtsdZnAK+q48wtIP6pIpw5shSJ5LnA0qeN/f4TvTFDV6ItYIXjiWWpTECc/Bxmfnyat3B5xWCu9nvz8fEs7Ns0TuzQwT3/K55iSKDEIi/E0nO97xwIDAQAB"
.
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#sig
sig
http://purl.org/nanopub/x/hasSignature
has the signature
(this is a literal)
"lUGuTihITpSBPC1WF/Na8tXgPw2UeCdCKt1Z7VLl0Aq1DKhqi52cROTJZ0PhS/unqNjVpM+W8BiMHbwSNH5zDsT04upJOTVdHC2ghxFXO2jZ2YeFoZe8ZrOUkVrsO4fDytVI8AptUiDDOn3tWN13J70E+2utIO7SBjG/pitQ62t7Nj1N1qZVHehz7McKlIfP3IB6arWD9WOHIU4lYlpyYFsYE7dlHBvjdW8gr4xwPSChdB356QdPXYphIwjVZBlMujhZhStKs5oVdlfKnfqvYxf8Dfsdh+paShLwmBR3hfJ4NN8ADDkW/VDbOvDzYgqLb2decJxM2PStBT84SH0yRg=="
.
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
This nanopublication
http://purl.org/nanopub/x/wasCreatedAt
was created at
https://sense-nets.xyz/
Sensenets
.
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#sig
sig
http://purl.org/nanopub/x/singedBy
singedBy
https://sense-nets.xyz/
Sensenets
.
This is a local identifier minted within the nanopublication.
https://w3id.org/np/RAszCcnWVT...#sig
sig
http://www.w3.org/ns/prov#wasAssociatedWith
wasAssociatedWith
https://w3id.org/np/RAoSadUw99...T86OrTzk16VtssigningDelegation
RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16VtssigningDelegation
.
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
this nanopublication
http://purl.org/dc/terms/creator
creator
https://w3id.org/np/RAoSadUw99...
Leshem Choshen π€π€ @ICML wanna talk?
.
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
this nanopublication
http://purl.org/dc/terms/license
license
https://creativecommons.org/licenses/by/4.0/
4.0
.
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
this nanopublication
http://www.w3.org/ns/prov#wasAttributedTo
wasAttributedTo
https://orcid.org/0000-0002-0085-6496
0000-0002-0085-6496
.
This is the identifier for this whole nanopublication.
https://w3id.org/np/RAszCcnWVT...
this nanopublication
https://sense-nets.xyz/hasRootSigner
hasRootSigner
(this is a literal)
"0xf6ECcfD463afB464dcC85b051DF2E93E2646E6D2"
.