Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
EuroCropsML Documentation
EuroCropsML Documentation
  • 🔎 Overview
  • 🚀 Getting Started
  • 💡 Examples

📖 References

  • Dataset Reference
  • CLI Reference
  • API Reference
    • eurocropsml.acquisition
      • eurocropsml.acquisition.builder
        • eurocropsml.acquisition.builder.build_dataset
      • eurocropsml.acquisition.clipping
        • eurocropsml.acquisition.clipping.clipper
          • eurocropsml.acquisition.clipping.clipper.clipping
        • eurocropsml.acquisition.clipping.utils
          • eurocropsml.acquisition.clipping.utils.mask_polygon_raster
      • eurocropsml.acquisition.collector
        • eurocropsml.acquisition.collector.acquire_sentinel_tiles
      • eurocropsml.acquisition.config
        • eurocropsml.acquisition.config.AcquisitionConfig
          • eurocropsml.acquisition.config.AcquisitionConfig.relative_path
          • eurocropsml.acquisition.config.AcquisitionConfig.model_config
          • eurocropsml.acquisition.config.AcquisitionConfig.raw_data_dir
          • eurocropsml.acquisition.config.AcquisitionConfig.output_dir
          • eurocropsml.acquisition.config.AcquisitionConfig.eodata_dir
          • eurocropsml.acquisition.config.AcquisitionConfig.local_dir
          • eurocropsml.acquisition.config.AcquisitionConfig.country_config
          • eurocropsml.acquisition.config.AcquisitionConfig.workers
          • eurocropsml.acquisition.config.AcquisitionConfig.chunk_size
          • eurocropsml.acquisition.config.AcquisitionConfig.multiplier
          • eurocropsml.acquisition.config.AcquisitionConfig.rebuild
        • eurocropsml.acquisition.config.CollectorConfig
          • eurocropsml.acquisition.config.CollectorConfig.post_init
          • eurocropsml.acquisition.config.CollectorConfig.model_config
          • eurocropsml.acquisition.config.CollectorConfig.country
          • eurocropsml.acquisition.config.CollectorConfig.year
          • eurocropsml.acquisition.config.CollectorConfig.months
          • eurocropsml.acquisition.config.CollectorConfig.satellite
          • eurocropsml.acquisition.config.CollectorConfig.product_type
          • eurocropsml.acquisition.config.CollectorConfig.processing_level
          • eurocropsml.acquisition.config.CollectorConfig.operational_mode
          • eurocropsml.acquisition.config.CollectorConfig.max_cloud_cover
          • eurocropsml.acquisition.config.CollectorConfig.bands
          • eurocropsml.acquisition.config.CollectorConfig.max_requested_products
          • eurocropsml.acquisition.config.CollectorConfig.country_code
          • eurocropsml.acquisition.config.CollectorConfig.ec_filename
          • eurocropsml.acquisition.config.CollectorConfig.shapefile_folder
          • eurocropsml.acquisition.config.CollectorConfig.shapefile
          • eurocropsml.acquisition.config.CollectorConfig.polygon
          • eurocropsml.acquisition.config.CollectorConfig.parcel_id_name
        • eurocropsml.acquisition.config.Config
          • eurocropsml.acquisition.config.Config.model_config
          • eurocropsml.acquisition.config.Config.cfg
        • eurocropsml.acquisition.config.EuroCropsCountryConfig
          • eurocropsml.acquisition.config.EuroCropsCountryConfig.model_config
          • eurocropsml.acquisition.config.EuroCropsCountryConfig.countries
          • eurocropsml.acquisition.config.EuroCropsCountryConfig.parcel_ids
          • eurocropsml.acquisition.config.EuroCropsCountryConfig.polygon
      • eurocropsml.acquisition.copier
        • eurocropsml.acquisition.copier.merge_safe_files
      • eurocropsml.acquisition.region
        • eurocropsml.acquisition.region.add_nuts_regions
      • eurocropsml.acquisition.utils
    • eurocropsml.dataset
      • eurocropsml.dataset.base
        • eurocropsml.dataset.base.custom_collate_fn
        • eurocropsml.dataset.base.DataItem
          • eurocropsml.dataset.base.DataItem.__init__
          • eurocropsml.dataset.base.DataItem.to
        • eurocropsml.dataset.base.LabelledData
          • eurocropsml.dataset.base.LabelledData.from_tensor_dict
          • eurocropsml.dataset.base.LabelledData.to_tensor_dict
          • eurocropsml.dataset.base.LabelledData.to_tuple
          • eurocropsml.dataset.base.LabelledData.data
          • eurocropsml.dataset.base.LabelledData.data_item
          • eurocropsml.dataset.base.LabelledData.label
          • eurocropsml.dataset.base.LabelledData.meta_data
        • eurocropsml.dataset.base.TensorDataset
          • eurocropsml.dataset.base.TensorDataset.__init__
        • eurocropsml.dataset.base.TransformDataset
          • eurocropsml.dataset.base.TransformDataset.__init__
          • eurocropsml.dataset.base.TransformDataset.concat
          • eurocropsml.dataset.base.TransformDataset.overlaps
          • eurocropsml.dataset.base.TransformDataset.subset
      • eurocropsml.dataset.config
        • eurocropsml.dataset.config.EuroCropsConfig
          • eurocropsml.dataset.config.EuroCropsConfig.model_config
          • eurocropsml.dataset.config.EuroCropsConfig.preprocess
          • eurocropsml.dataset.config.EuroCropsConfig.split
        • eurocropsml.dataset.config.EuroCropsDatasetConfig
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.__init__
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.post_init
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.model_config
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.remove_s2_bands
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.date_type
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.filter_clouds
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.normalize
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.data_sources
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.s1_bands
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.s2_bands
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.year
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.max_samples
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.metrics
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.split
          • eurocropsml.dataset.config.EuroCropsDatasetConfig.total_num_channels
        • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.relative_path
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.model_config
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.download_url
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.raw_data_dir
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.preprocess_dir
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.band4_t1
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.band4_t2
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.band4_prob_threshold
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.filter_clouds
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.num_workers
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.excl_classes
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.keep_classes
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.satellite
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.bands
          • eurocropsml.dataset.config.EuroCropsDatasetPreprocessConfig.year
        • eurocropsml.dataset.config.EuroCropsSplit
          • eurocropsml.dataset.config.EuroCropsSplit.relative_path
          • eurocropsml.dataset.config.EuroCropsSplit.model_config
          • eurocropsml.dataset.config.EuroCropsSplit.base_name
          • eurocropsml.dataset.config.EuroCropsSplit.data_dir
          • eurocropsml.dataset.config.EuroCropsSplit.random_seed
          • eurocropsml.dataset.config.EuroCropsSplit.num_samples
          • eurocropsml.dataset.config.EuroCropsSplit.meadow_class
          • eurocropsml.dataset.config.EuroCropsSplit.satellite
          • eurocropsml.dataset.config.EuroCropsSplit.year
          • eurocropsml.dataset.config.EuroCropsSplit.benchmark
          • eurocropsml.dataset.config.EuroCropsSplit.pretrain_classes
          • eurocropsml.dataset.config.EuroCropsSplit.finetune_classes
          • eurocropsml.dataset.config.EuroCropsSplit.pretrain_regions
          • eurocropsml.dataset.config.EuroCropsSplit.finetune_regions
      • eurocropsml.dataset.dataset
        • eurocropsml.dataset.dataset.EuroCropsDataset
          • eurocropsml.dataset.dataset.EuroCropsDataset.__init__
      • eurocropsml.dataset.download
        • eurocropsml.dataset.download.download_dataset
        • eurocropsml.dataset.download.get_user_choice
        • eurocropsml.dataset.download.select_version
      • eurocropsml.dataset.preprocess
        • eurocropsml.dataset.preprocess.find_clouds
        • eurocropsml.dataset.preprocess.get_class_ids_to_names
        • eurocropsml.dataset.preprocess.preprocess
        • eurocropsml.dataset.preprocess.read_metadata
      • eurocropsml.dataset.splits
        • eurocropsml.dataset.splits.create_splits
        • eurocropsml.dataset.splits.get_split_dir
        • eurocropsml.dataset.splits.split_dataset_by_class
        • eurocropsml.dataset.splits.split_dataset_by_region
      • eurocropsml.dataset.utils
        • eurocropsml.dataset.utils.pad_seq_to_366
        • eurocropsml.dataset.utils.read_files
        • eurocropsml.dataset.utils.MMapMetadata
          • eurocropsml.dataset.utils.MMapMetadata.__init__
          • eurocropsml.dataset.utils.MMapMetadata.sorted_used_files
        • eurocropsml.dataset.utils.MMapStore
          • eurocropsml.dataset.utils.MMapStore.__init__
          • eurocropsml.dataset.utils.MMapStore.all_mmaps

🚩 Project Links

  • License and Credits
  • PyPI
  • GitHub
  • Zenodo
  • Contributing
Back to top

eurocropsml.dataset.preprocess.preprocess¶

preprocess(preprocess_config: EuroCropsDatasetPreprocessConfig, nuts_level: Literal[1, 2, 3] = 3) → None¶

Run preprocessing.

Next
eurocropsml.dataset.preprocess.read_metadata
Previous
eurocropsml.dataset.preprocess.get_class_ids_to_names
Copyright © 2024, Joana Reuss, Jan Macdonald
Made with Sphinx and @pradyunsg's Furo
On this page
  • eurocropsml.dataset.preprocess.preprocess
    • preprocess()