I have a azure boards project with simple flow.
We only use Epics / Issues, almost never work-items for sake of simplicity.
Can I customize the Sprint Taskboard (or create new board), so that it will show Issues in the state columns instead workitems?
You can customize the Product backlog Board to do exactly what you want. In which case you could completely ignore the "Sprints":
If needed add additional columns: