aitool.datasets package

Subpackages

• aitool.datasets.nlp package
  • Subpackages
    • aitool.datasets.nlp.classification package
      • Submodules
      • aitool.datasets.nlp.classification.classtest module
      • Module contents
  • Module contents

Submodules

aitool.datasets.utils module

aitool.datasets.utils.calculate_md5(fpath: str, chunk_size: int = 1048576) → str

aitool.datasets.utils.check_integrity(fpath: str, md5: Optional[str] = None) → bool

aitool.datasets.utils.check_md5(fpath: str, md5: str, **kwargs: Any) → bool

aitool.datasets.utils.download_and_extract_archive(url: str, download_root: str, extract_root: Optional[str] = None, filename: Optional[str] = None, md5: Optional[str] = None, remove_finished: bool = False) → None

aitool.datasets.utils.download_url(url: str, root: str, filename: Optional[str] = None, md5: Optional[str] = None) → None

Download a file from a url and place it in root.

Args:

url (str): URL to download file from root (str): Directory to place downloaded file in filename (str, optional): Name to save the file under. If None, use the basename of the URL md5 (str, optional): MD5 checksum of the download. If None, do not check

aitool.datasets.utils.extract_archive(from_path: str, to_path: Optional[str] = None, remove_finished: bool = False) → None

aitool.datasets.utils.gen_bar_updater() → Callable[[int, int, int], None]

Module contents