Announcement

Collapse
No announcement yet.

Hybrid on EC2 spot fleets?

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Hybrid on EC2 spot fleets?

    Not sure where this goes BUT - has anyone gotten hybrid rendering working on ec2 spots? I'm using deadline and the vrscene submitter, selecting "vray rt (cuda)" as the render engine, however, the linux AMI's are giving errors and failing. I sort of assumed they would kick over to just cpu, but that doesn't seem to be the case. Just curious if anyone has had any luck

    Code:
    2018-03-20 22:48:59:  0: STDOUT: [2018/Mar/20|22:48:59] Loading light map from file "/mnt/Data/U4de81062dd1a43b3b551c71b9468c33b/SHEPLEY/15-NOTRE-DAME/3d-cad/textures/DRAFT1_ADD.vrlmap"...
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Light map loaded successfully.
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Running RTEngine
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Initializing CUDA renderer (single kernel version)...
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] NVIDIA CUDA not found. V-Ray GPU can run with C++/CPU device only
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Querying for CUDA devices...
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Using all available CUDA GPU devices. Not using CUDA CPU, it should be selected explicitly!
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] error: There is no device supporting at least CUDA 2.0!
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] warning: initDevices() failed. Please check that your system has compatible GPU devices installed.
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Average rays per light cache sample: inf (min 1, max 1)
    2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Using premultiplied light cache.
    2018-03-20 23:04:59:  0: Done executing plugin command of type 'Render Task'

  • #2
    You need to set the environment variable VRAY_OPENCL_PLATFORMS_x64 to "c++/cpu" without the quotes.

    Best regards,
    Vlado
    I only act like I know everything, Rogers.

    Comment


    • #3
      Originally posted by vlado View Post
      You need to set the environment variable VRAY_OPENCL_PLATFORMS_x64 to "c++/cpu" without the quotes.

      Best regards,
      Vlado
      any hints on nomenclature? I tried every variation I could think of in the command line box, but nothing seemed to work (call caps, lower case, just intel, just c++, just cpu, etc etc)

      Code:
      2018-03-21 00:30:43: 0: INFO: Stdout Redirection Enabled: True
      
      2018-03-21 00:30:43: 0: INFO: Asynchronous Stdout Enabled: False
      
      2018-03-21 00:30:43: 0: INFO: Stdout Handling Enabled: True
      
      2018-03-21 00:30:43: 0: INFO: Popup Handling Enabled: False
      
      2018-03-21 00:30:43: 0: INFO: Using Process Tree: True
      
      2018-03-21 00:30:43: 0: INFO: Hiding DOS Window: True
      
      2018-03-21 00:30:43: 0: INFO: Creating New Console: False
      
      2018-03-21 00:30:43: 0: INFO: Running as user: ec2-user
      
      2018-03-21 00:30:43: 0: INFO: Executable: "/usr/autodesk/mayaIO2017/vray/bin/vray"
      
      2018-03-21 00:30:43: 0: CheckPathMapping: Swapped "U:\SHEPLEY\15-NOTRE-DAME\animation\raw frames\special collections\DRAFT1_SHOT3_ALPHA.####.exr" with "/mnt/Data/U4de81062dd1a43b3b551c71b9468c33b/SHEPLEY\15-NOTRE-DAME\animation\raw frames\special collections\DRAFT1_SHOT3_ALPHA.####.exr"
      
      2018-03-21 00:30:43: 0: INFO: Argument: -scenefile="/home/ec2-user/Thinkbox/Deadline10/slave/ip-10-128-22-16/jobsData/5ab17948a55e62532032332b/thread0_tempF64BC0/SHOT3_ALPHA.vrscene" -interactive=0 -display=0 -rtEngine=5 -rtTimeOut=0.0 -rtNoise=0.4 -rtSampleLevel=0 -frames=0 -noFrameNumbers=1 -imgFile="/mnt/Data/U4de81062dd1a43b3b551c71b9468c33b/SHEPLEY/15-NOTRE-DAME/animation/raw frames/special collections/DRAFT1_SHOT3_ALPHA.0000.exr" -numThreads=0 -imgWidth=1920 -imgHeight=1080 -vray_opencl_platforms_x64=c++;cpu;nvidia
      
      2018-03-21 00:30:43: 0: INFO: Full Command: "/usr/autodesk/mayaIO2017/vray/bin/vray" -scenefile="/home/ec2-user/Thinkbox/Deadline10/slave/ip-10-128-22-16/jobsData/5ab17948a55e62532032332b/thread0_tempF64BC0/SHOT3_ALPHA.vrscene" -interactive=0 -display=0 -rtEngine=5 -rtTimeOut=0.0 -rtNoise=0.4 -rtSampleLevel=0 -frames=0 -noFrameNumbers=1 -imgFile="/mnt/Data/U4de81062dd1a43b3b551c71b9468c33b/SHEPLEY/15-NOTRE-DAME/animation/raw frames/special collections/DRAFT1_SHOT3_ALPHA.0000.exr" -numThreads=0 -imgWidth=1920 -imgHeight=1080 -vray_opencl_platforms_x64=c++;cpu;nvidia
      
      2018-03-21 00:30:43: 0: INFO: Startup Directory: "/usr/autodesk/mayaIO2017/vray/bin"

      Comment


      • #4
        This is an environment variable that needs to be set before running V-Ray itself; it?s not a command-line option (we should probably do that though). Depending on which Linux distribution and command shell you are using, the environment is set up differently. For bash, it would be something like
        Code:
        export VRAY_OPENCL_PLATFORMS_x64=c++/cpu
        And then you can run V-Ray as normal.

        Best regards,
        Vlado
        I only act like I know everything, Rogers.

        Comment


        • #5
          Yeah, I have no idea either. Don't even know how to find out which distro these AMI's are running. I'm trying to hash it out with thinkbox, but no solid progress to report yet - still not sure how to pass the command thru. They are recommending as an environmental variable, but for the life of me, I can't figure out the exact phrasing:

          https://docs.thinkboxsoftware.com/pr...nt#environment

          I tried it as a remote command (https://docs.thinkboxsoftware.com/pr...-and-balancers) but still couldn't figure out the exact wording needed - if that method was viable at all to begin with.

          Will report back with progress, if anyone has any ideas, I'd gladly contribute to a cookie/beer jar!

          Comment


          • #6
            They way I do that is by starting Deadline Slave from batch job, though this is in Windows, but before I start it, I override the env var for devices. I'm pretty much sure it would work the same in Linux.
            That's how it looks on my end - http://www.dabarti.com/screens/s67ca...060255bd9Z.png . The env var is passed to child process (to deadline slave and than to vray.exe).

            Alternatively you can set env var globally for the whole job: vhttp://www.dabarti.com/screens/s2baf7205-8141-4005-a5c5-b052cee997e5Y.png

            Best,
            Tomasz
            @wyszolmirski | Dabarti | FB | BE

            Comment


            • #7
              Progress! Using the environmental variable as such

              key:
              VRAY_OPENCL_PLATFORMS_x64

              value:
              c++/cpu


              Seems to be working on the AWS instances. I put everything under value before and that's when it was failing out. Stupid mistake, in hindsight

              Comment


              • #8
                tested it with the AWS portal env variable and works! I think I prefer this way as its a bit cleaner and will only apply to my AWS fleets, leaving the rest of my farm alone. I know this isn't strictly vray related, but hopefully this will help someone struggling with integrating hybrid into their farm.

                Comment


                • #9
                  Great! Let us know how it goes.

                  Best regards,
                  Vlado
                  I only act like I know everything, Rogers.

                  Comment

                  Working...
                  X