Remote Dataset Loading

• DatasetFolder

directory/
├── class_x
│   ├── xxx.ext
│   ├── xxy.ext
│   └── ...
│       └── xxz.ext
└── class_y
    ├── 123.ext
    ├── nsdf3.ext
    └── ...
    └── asd932_.ext

• ImageFolder

root/dog/xxx.png
root/dog/xxy.png
root/dog/[...]/xxz.png

root/cat/123.png
root/cat/nsdf3.png
root/cat/[...]/asd932_.png

In [ ]:

import os

os.chdir("../../")

import os os.chdir("../../")

In [ ]:

from gradsflow.data.image import (
    RayImageFolder,
    get_augmentations,
)
from torchvision import transforms as T

from gradsflow.data.image import ( RayImageFolder, get_augmentations, ) from torchvision import transforms as T

In [ ]:

transforms = get_augmentations()

ds = RayImageFolder(
    "/Users/aniket/Pictures/data/train/",
    transforms,
)

transforms = get_augmentations() ds = RayImageFolder( "/Users/aniket/Pictures/data/train/", transforms, )

In [ ]:

iter_ds = iter(ds)

iter_ds = iter(ds)

In [ ]:

T.ToPILImage()(next(iter_ds)[0])

T.ToPILImage()(next(iter_ds)[0])

Out[ ]:

---

Last update: May 18, 2022