Metal Ray Tracing – SceneKit or RealityKit
The WWDC21 talk below shows how to "Enhance your app with Metal ray tracing".
How can I add Metal ray tracing to a SceneKit or RealityKit app?
Any basic example or reference code would be hugely appreciated!
It took me some time to prepare example apps for you and anyone else interested in this topic. The apps are pure Swift with Metal and are currently designed to run on iOS platforms. (I personally recommend a fast device)
Here you can find the first "simple" default Apple RayTracer:
https://github.com/philvanza/SceneKit-RayTracing
And here the same app with an additional, more complex RayTracer that supports BSDF (Bidirectional Scattering Distribution Function) which allows you to RayTrace i.Ex. transparent glass:
https://github.com/philvanza/SceneKit-RayTracing-Advanced
Basically you need the following to achive RayTracing:
- Extract the geometry data from the SceneKit node you want to RayTrace
- Build a triangle acceleration structure (Metal specific)
- Prepare the buffers to execute on the GPU
- Send the whole stuff to the RayTracer
- Accumulate the output image over time
The longer you let the RayTracer run, the better the result becomes.
It would take too much code to add here, so I prepared this repositories. Feel free to leave me a comment on whatever you think about the RayTracers.
Have fun!
- Format UILabel with bullet points?
- Swift image does not fit in the scrollview
- How to stop showing AdMob banner ad correctly?
- iOS built in solution for managing keyboard pushes or overlaps to UI elements
- SwiftUI List seems to add padding to internal elements
- How to eliminate the space above Section in SwiftUI Form?
- @StateObject vs @ObservedObject when passed externally but owned by the view
- Is there a more elegant way to pull off a regular to bold text animation in SwiftUI
- Effect of change of frame of View on Subviews
- AVCapturePhotoOutput - settings may not be reused
- SwiftUI. How to change the placeholder color of the TextField?
- 'InfoKey' is not a member type of 'UIImagePickerController'
- FireBase notification not working on new installs
- SwiftUI background color of List Mac OS
- Enum: Count and list all cases (from outside!)
- How to access a .swift file in a different folder from main.swit file on replit for Swift?
- How to create a 24 hour timer?
- Mixing Task with Future Publisher in Swift 6 with strict concurrency checking
- iOS 15: Remove empty space before cells in UITableView
- How to group a set of pictures in a specific way using the current view size in SwiftUI
- Subscript For Structure
- Swift concurrency confusing Sendability error
- How come I can cast to NSManagedObject but not to my entity's type?
- Multiple freezes in collection view
- Does anyone know why Picker from my view file won't accept the binding version of an observable object property using @Observable
- How to wait a value from api response for login view using swift
- Business model changes by using the app transaction - StoreKit 2
- Change size (height) of ProgressView in SwiftUI
- Negative number modulo in swift
- Using a ForEach loop to show the key and value of dictionary items in a Form view in SwiftUI