Maniphest T101287

Cycles crashes on viewport rendering in CUDA driver
Needs Triage, Normal
Actions

Assigned To
None
Authored By
Piero (phoenixart)
Sep 23 2022, 5:19 AM
Tags
  • BF Blender
Subscribers
Omar Emara (OmarSquircleArt)
Philipp Oeser (lichtwerk)
Piero (phoenixart)
Richard Antalik (ISS)
Robert Guetzkow (rjg)

Description

System Information
Operating system: Windows-10-10.0.19043-SP0 64 Bits
Graphics card: NVIDIA GeForce GTX 1080 Ti/PCIe/SSE2 NVIDIA Corporation 4.5.0 NVIDIA 516.94

Blender Version
Broken: version: 3.3.0, branch: master, commit date: 2022-09-06 15:39, hash: rB0759f671ce1f
Worked: 3.2

Short description of error
The crash happens while navigating the viewport in shading mode, using Cycles.

Exact steps for others to reproduce the error
This crash reappeared in the latest 3.3 release. It happened in older releases, then it got stable, but now it's back again.
Apparently, it has to do with Cuda.
It's not happening in one particular scene only, but rather randomly regardless of the complexity of the scene.

Cave-CloseUp-v006.crash.txt86 KBDownload

Cave-CloseUp-v005.crash.txt11 KBDownload

blender.crash.txt12 KBDownload

Event Timeline

Piero (phoenixart) created this task.Sep 23 2022, 5:19 AM
Piero (phoenixart) added a comment.Sep 24 2022, 2:59 AM

Just got more crashes.
The last one, happened right after I tried to switch from Viewport Shading to Solid.
Log attached.

Moi3D-test-04.crash.txt30 KBDownload

Omar Emara (OmarSquircleArt) changed the task status from Needs Triage to Needs Information from User.Sep 26 2022, 1:29 PM
Omar Emara (OmarSquircleArt) added a subscriber: Omar Emara (OmarSquircleArt).

The crashes seems to happen in the Nvidia driver. Are you using the Game or Studio version of the Nvidia driver? If you aren't using the Studio version, can you try to install it and see if that fixes the issue?

Piero (phoenixart) added a comment.Sep 27 2022, 4:18 AM

Thanks for checking the logs, @Omar Emara (OmarSquircleArt)
I'm already using the Studio driver. I've also just updated to the latest 517.40, but no luck.

Omar Emara (OmarSquircleArt) added a comment.Sep 27 2022, 1:28 PM

Issues like this might be caused by instability due to overclocking. Did you happened to overclock your GPU using things like After Burner or adjusted any particular setting in the driver utilities?

Piero (phoenixart) added a comment.Sep 27 2022, 8:06 PM

Not at all, never overclocked.

This issue used to happen with an older version of Blender. At the time, I submitted the issue, and on BA other users reported the same problem. I can track down what Blender version was that.
Then, it was fixed. It now reappeared on 3.3.

Omar Emara (OmarSquircleArt) renamed this task from Crash while in Viewport Shading mode with Cycles to Cycles crashes on viewport rendering in CUDA driver.Sep 27 2022, 8:52 PM
Omar Emara (OmarSquircleArt) changed the task status from Needs Information from User to Needs Triage.
Richard Antalik (ISS) changed the task status from Needs Triage to Needs Information from User.EditedSep 27 2022, 9:29 PM
Richard Antalik (ISS) added a subscriber: Richard Antalik (ISS).

@Piero (phoenixart) can you provide simplified (in a way that still crashes) .blend file?

Piero (phoenixart) added a comment.Sep 29 2022, 11:04 PM

Thanks, Richard (by the way, when I type @ your name, the system can't find you)

At the moment, It's a little complicated for me to provide a blend file. The one I'm working on is a bit heavy, and above all under NDA.
I'll see if I get the same issue on a simpler, generic blend scene.

That said, here are two things I've noticed:

  1. It usually crashes when going back from Rendered to Solid mode
  2. It also happens when switching viewport denoise on and off. I can tell it's going to crash if after switching the denoise off I turn it back on, though the denoise is not being applied. At that point, changing to Solid mode will surely crash Blender.
Richard Antalik (ISS) added a comment.Sep 30 2022, 3:33 PM

Understand that. In any case we need reproducible case in order to fix it. Also please check if system is running out of memory.

Piero (phoenixart) added a subscriber: Richard van der Veen (richard).EditedOct 7 2022, 11:09 PM

Richard After more testing, other than the issue happening when turning viewport denoise on/ff, it seems there's indeed a problem with the VRam. Is there a way in Blender to purge the vRam used?

Piero (phoenixart) added a comment.Oct 17 2022, 7:56 AM

Richard,

If you have Scatter 5, try the Blend for Physically Accurate Mowed Grass from here
https://sites.google.com/view/scatter5docs/example-files?authuser=0

After turning off the denoise, moving in the viewport for a bit, and switching to solid, Blender crashed.

Piero (phoenixart) added a comment.Oct 20 2022, 12:12 AM

Ok, I managed to reproduce the issue, it's consistent, and it doesn't need to be a heavy scene.
Also, this happens no matter what settings I use for the viewport denoise.

Here's a screen record:

Richard Antalik (ISS) removed a subscriber: Richard van der Veen (richard).Oct 20 2022, 5:50 PM

Sorry for late response, So if I understand this correctly, only thing needed to cause crash is to enable viewport denoising in cycles and switch a few times between rendered and solid shading? Can't reproduce that, but I think there are developers with access to 1080 gpu.

Also you tag people here by handles, so I am @ISS.

Piero (phoenixart) added a comment.Oct 20 2022, 6:06 PM

Thanks Richard,

I'm not able to pull your name from the drop-down menu

As for the issue, yes, it's sufficient to switch from viewport denoise on, to off, and then to solid to make Blender quit with no warning.
Lastly, to be precise the GPUs are 1080 ti.

Richard Antalik (ISS) added a subscriber: Robert Guetzkow (rjg).Oct 20 2022, 6:36 PM
In T101287#1435080, @Piero (phoenixart) wrote:

As for the issue, yes, it's sufficient to switch from viewport denoise on, to off, and then to solid to make Blender quit with no warning.

@Robert Guetzkow (rjg) can you check in 3.3 with default startup?

Robert Guetzkow (rjg) added a comment.Oct 20 2022, 9:43 PM

@Richard Antalik (ISS) I could not reproduce a crash. Might require specific timing between switching viewport render modes?

Piero (phoenixart) added a comment.Oct 20 2022, 10:13 PM

@Robert Guetzkow (rjg) @Richard Antalik (ISS)

Here's a screen record with default settings

Richard Antalik (ISS) changed the task status from Needs Information from User to Needs Triage.Oct 24 2022, 9:26 PM

Not quite sure about exact prerequisites from the video. It would be best if this could be narrowed down to 100% reproducibility, but still given, that crash happens in GPU driver not sure if issue is fixable on our side. I would perhaps report this to Nvidia https://nvidia.custhelp.com/app/answers/detail/a_id/4512/~/i-found-a-bug,-where-do-i-go-to-report-it?

Alternatively you can try studio drivers or try downgrade to older versions.
In any case I think I don't need any more information

Philipp Oeser (lichtwerk) changed the task status from Needs Triage to Needs Information from User.Nov 21 2022, 2:36 PM
Philipp Oeser (lichtwerk) added a subscriber: Philipp Oeser (lichtwerk).

No repro here

**System Information**
Operating system: Linux-6.0.5-200.fc36.x86_64-x86_64-with-glibc2.35 64 Bits
Graphics card: NVIDIA GeForce RTX 3080 Laptop GPU/PCIe/SSE2 NVIDIA Corporation 4.5.0 NVIDIA 520.56.06
version: 3.1.1, branch: master, commit date: 2022-03-29 17:50, hash: `rBd91843f3b6c6`

Just to make sure: is this still an issue with the 3.3.1 release?

Piero (phoenixart) added a comment.EditedNov 21 2022, 6:03 PM

@Philipp Oeser (lichtwerk) yes, it happens with 3.3.1

Edit: actually, even with 3.3.2

Philipp Oeser (lichtwerk) changed the task status from Needs Information from User to Needs Triage.Nov 21 2022, 6:09 PM