Instructions to use ctheodoris/Geneformer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ctheodoris/Geneformer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ctheodoris/Geneformer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("ctheodoris/Geneformer") model = AutoModelForMaskedLM.from_pretrained("ctheodoris/Geneformer", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit History
-
Use dynamic CUDA check instead of hardcoded device in perturber_utils.py (#594)
- Use dynamic CUDA check instead of hardcoded device in perturber_utils.py (56e641c1ae62d2fc171810e53e259e59adc0102a) Co-authored-by: Deepali Lehri <dlgenomics@users.noreply.huggingface.co>1f7fbae
-
Update README.md
Verified signature04c2b2e
-
Update geneformer/mtl/model.py (#585)
- Update geneformer/mtl/model.py (33693688b3eaa03e4ed385a115e3a74ae37af9ff) Co-authored-by: FMT <MajorasMeow@users.noreply.huggingface.co>ad8f66d
-
update readme citations
Verified signaturefcd26c4
-
Update geneformer/mtl/train.py (#582)
- Update geneformer/mtl/train.py (07a0e116c873277b09831be99b44bf03712fa460) Co-authored-by: FMT <MajorasMeow@users.noreply.huggingface.co>05fcbeb
-
default id_class_dict to None for gene classifiers
Christina Theodorisf45a6c7
-
track metadata in predictions
Christina Theodorisbe98543 -
add emb extractor option for saving all gene embs
Christina Theodorisfb6abe0 -
add pickle suffix option to isp stats
Christina Theodoris5cada60 -
Fix TypeError in make_perturbation_batch_special (#567)
Verified signature- Fix TypeError in make_perturbation_batch_special (bf552476e397005bcb845728a500bbd213fa29e3) Co-authored-by: Sosuke Hosokawa <so298@users.noreply.huggingface.co>05a3a20
-
add empty tokenized_counts for loom to pass until keep_counts implemented
Verified signature7ec90d6
-
subsample heatmap with max_ncells_to_plot when max_ncells is None
Verified signature9187fee
-
tokenizer zarr integration (#561)
Verified signature- include support for zarr file format for tokenizer. (df1ed01b336c75ba82f2eec9275d36be2dab680e) - ensure anndata/zarr returns data rather than dir if not collapse_gene_ids (0efc3b3329af5ee31fd7b0a6b2ebfc5cc023deed)91215c4
-
Update geneformer/perturber_utils.py to be compatible with different versions of the datasets package. (#553)
Verified signature- Update geneformer/perturber_utils.py to be compatible with different versions of the datasets package. (4dff012a78fa6883131b3de91989e8d2e7e77a99) Co-authored-by: Kenji Watanabe <IchigoJiken@users.noreply.huggingface.co>1930588 -
Update geneformer/evaluation_utils.py to be compatible with different versions of the datasets package. (#552)
Verified signature- Update geneformer/evaluation_utils.py to be compatible with different versions of the datasets package. (fc7a1c00c86cf62d3677d14a1d70b7b8c37236bb) Co-authored-by: Kenji Watanabe <IchigoJiken@users.noreply.huggingface.co>b2dc06c
-
add input_identifier to tokenize specific matched files
Christina Theodorisac59e36
-
plot umap for all labels in same view
Christina Theodorisff551ee -
Update README.md
Verified signature13cd541
-
silence tensor copy warning
Christina Theodoris9d8d2f0 -
clone rather than wrap tensors
Christina Theodorisaea4988 -
update collator with dummy save fn for transformers compatibility
Christina Theodorisf17618a
-
fix to properly move model after checking device
Christina Theodorisf953554 -
move model to device after checking
Christina Theodorisefc403d -
update V1 token dict usage to self attr
Christina Theodorisf26136d -
move V1 autoformatting to after validate_options
Christina Theodoris4364d31
-
add option for relabeling data from prior label class dict, update dict paths in manifest
Christina Theodoris76a78a0
-
delete first version of dist multitask example
Verified signaturea67c9c0
-
update dist multitask example name
Christina Theodoris596f1c2 -
Add example notebook for distributed multi-task cell classification (#543)
Verified signature- Add example notebook for distributed multi-task cell classification (7094feb8be9734a624cc561c8ebf5d571949873d) Co-authored-by: Madhavan Venkatesh <madhavanvvs@users.noreply.huggingface.co>f3ff19d
-
specify bitsandbites version
Christina Theodoris6a50f33 -
add V2 models
Christina Theodoris7cf49a3 -
update with V2 models
Christina Theodorisd319fef
-
edit docs to remove backend isp functions
Christina Theodoris31bf641
-
fix TypeError: TrainingArguments.__init__() got an unexpected keyword argument 'evaluation_strategy' (#539)
Verified signature- fix TypeError: TrainingArguments.__init__() got an unexpected keyword argument 'evaluation_strategy' (af5699d3d03a21594973b7159b1b1c3d85fca067) Co-authored-by: Jack Kuo <jackkuo@users.noreply.huggingface.co>42dbf0a
-
add fallback task_type for LoraConfig to support different PEFT versions (#538)
Verified signature- add fallback task_type for LoraConfig to support different PEFT versions (7e575a07f75854fb428378a36fda54d912c1136a) Co-authored-by: Madhavan Venkatesh <madhavanvvs@users.noreply.huggingface.co>d471d1b
-
update eval_strategy for new transformers version
Christina Theodoris18a2ca6 -
move import wandb to conditional
Christina Theodoris7e4697d
-
fully qualified imports to resolve name-space conflicts (#532)
Verified signature- fully qualified imports to resolve name-space conflicts (caecdb154a416524f4913dde407ee7a5bb9d1d2a) Co-authored-by: Madhavan Venkatesh <madhavanvvs@users.noreply.huggingface.co>5f07ec8
-
ddp_mtl_nccl_support (#524)
Verified signature- Refactor MTL: DDP NCCL support (a794aecbbabbfe7e810f041c0b0a3b05e611a2fb)e2efe2b
-
edit imports in perturber_utils
Christina Theodorisc6d04a6
-
fix exact_mean subselection to be for index rather than col name
Christina Theodorisa13a2cf -
fix exact_mean and exact_median to subselect dataframe emb cols, not cell rows
Christina Theodoriscfc8cdb -
add quantization for pretrained model
Christina Theodoris7b591f6
-
Prepare data cell level pass cell state dict instead of genes (#483)
Verified signature- Update geneformer/classifier.py (107b2b84dd2a79cdba7470322d6c3637cc1d41ed) Co-authored-by: Han Chen <hchen725@users.noreply.huggingface.co>69e6887 -
ensure gene class dict only inverted when using gene classifier
Christina Theodoris54b408b
-
make plot roc compatible with eval-only metrics
Christina Theodorisae4867d -
Merge remote-tracking branch 'origin/main'
Christina Theodoris5760b30 -
fix gene class dict labeling
Christina Theodorisbfcada4
-
Fix how mappings and train and val data are returned (#473)
Verified signature- Update geneformer/mtl/data.py (cbf98f9a9115ccfe374a081b8758653d83f797b3) Co-authored-by: Han Chen <hchen725@users.noreply.huggingface.co>c81f6f9
-
Upload gene_name_id_dict_gc95M.pkl (#470)
Verified signature- Upload gene_name_id_dict_gc95M.pkl (db37c3e4de75ff21a48777e1be9bf8a0445c812b) Co-authored-by: Han Chen <hchen725@users.noreply.huggingface.co>01d3ea8