pythonparallel-processingpytorchgpumulti-gpu
PyTorch model output different dimension when using DataParallel
I implemented my PyTorch model with DataParallel for multi-GPU training. However, it seems that the model doesn't consistently output the right dimension. In the training loop, it seems that the model gave the correct output dimension for the first two batches, but it failed to do so for the third batch and caused an error when calculating the loss:
I also tried to use the solution from this post but it didn't help.
Solution
It seems like you are left with only one sample for the last batch. Try setting drop_last=True in your Dataloader: This will discard the last "not-full" batch.
- How to convert a python datetime.timedelta to years?
- Why does python allocate new memory to variables on every new assignment?
- Changing the GridSpec properties after generating the subplots
- Python virtual environment and `sys.path`
- Correct path of mock.patch
- Open document with default OS application in Python, both in Windows and Mac OS
- How can I parse (read) and use JSON in Python?
- how to choose certain amount of characters from a column in Python?
- Python unit tests run function after all test
- Do we ever need to synchronise threads in python?
- Reverse Inlines in Django Admin
- Object points and Image points in OpenCV calibrateCamera
- PDB won't stop on breakpoint
- Black formatter - Ignore specific multi-line code
- Polars Rolling Mean, fill start of window with null instead of shortened window
- Reading registers with pymodbus
- Read python output from another python script
- can't import gdal in python?
- How to close files using the pathlib module?
- Using PdfFileMerger in Python to merge PDFs with the same name, but different numbers
- Why is numpy's sine function so inaccurate at some points?
- I keep on getting a KeyError in Python
- NaN in mapper - name 'nan' is not defined
- Pandas groupby transform mean with date before current row for huge huge dataframe
- What does pip install . (dot) mean?
- Trying to Find Optimal Price Point in a Data Set
- How to create a whatsapp bot?
- Collatz Conjecture in Python
- ImportError: cannot import name 'url' from 'django.conf.urls' after upgrading to Django 4.0
- Polars Pivot Dataframe an count the cumulative uniques ID