Spaces:
Sleeping
Sleeping
File size: 872 Bytes
80cb919 a89888b 80cb919 a89888b 80cb919 a89888b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
"""
Utility package for the Medical Dataset Augmenter Space.
This package provides:
- drive_saver: Google Drive upload helper
- cloud_llm: API key rotation, paraphraser, translation/backtranslation
- local_llm: Load medalpaca-13B for augmentation, processing and translation
- datasets: Hugging Face dataset resolver & downloader
- processor: dataset-specific processing pipeline with augmentation
- schema: centralised SFT writer (JSONL + CSV)
- token: GCS project token refresher and authenticator
- augment: low-level augmentation utilities (text cleanup, deid, paraphrase hooks)
"""
from . import drive_saver
from . import cloud_llm
from . import local_llm
from . import datasets
from . import processor
from . import schema
from . import augment
from . import token
__all__ = ["drive_saver", "cloud_llm", "local_llm", "datasets", "processor", "schema", "augment"]
|