Video plays with no sound - GameGuru Forum

Author

Message

Avenging Eagle

19

Years of Service

User Offline

Joined: 2nd Oct 2005

Location: UK

Profile

Posted: 28th Aug 2018 22:48

Link

I don't want the player to have to sit on 2 minutes of loading screen immediately after the main menu, so I'm adding a very simple 'level 0' with nothing more than a player start marker sat on top of a storyzone and a winzone. The idea is I'd create a totally black map or room so the player doesn't realise they have just loaded into a tiny level per-say. However, while the storyzone will play the video and audio just fine when you walk into it from afar, it doesn't play audio when the player physically starts on the storyzone. Is this a bug? Has anyone else noticed this?

Sidenote: Which bright spark thought it would be a good idea to break up the video and audio for a storyzone into two different bits of media? I can't fathom a circumstance where you'd want the audio to not be that of the video file

AE

PM Email

synchromesh

Forum Support

10

Years of Service

User Offline

Joined: 24th Jan 2014

Location:

Profile

Posted: 29th Aug 2018 00:57 Edited at: 29th Aug 2018 00:59

Link

Quote: "Which bright spark thought it would be a good idea to break up the video and audio for a storyzone into two different bits of media? "

Microsoft ..

Quote: "Lee Bamber : The new DX11 engine does not support WMV as that would have dropped support for Windows 7 OS (thanks Microsoft). The new video player is a pure video playback system so only video at this stage. For audio, you can split out the soundtrack from the video and attach it to the sound field in the story zone properties as a WAV or OGG as it will play at the same time."

The only person ever to get all his work done by "Friday" was Robinson Crusoe..

PM

Teabone

Forum Support

18

Years of Service

User Offline

Joined: 8th Jun 2006

Location: Earth

Profile

Posted: 29th Aug 2018 01:24

Link

Hopefully the audio and video formats sync properly. I've not yet tested.

Twitter - Teabone3 | Youtube - Teabone3 | Twitch - Teabone3 | TGC Assets - Store Link | Patreon - Teabone3

i7 -2600 CPU @ 3.40GHz - Windows 7 - 8GB RAM - Nivida GeForce GTX 960

PM Website

synchromesh

Forum Support

10

Years of Service

User Offline

Joined: 24th Jan 2014

Location:

Profile

Posted: 29th Aug 2018 10:39

Link

I think Lee will find a work around … Its just not top of the to do list at the moment.

The only person ever to get all his work done by "Friday" was Robinson Crusoe..

PM

Ertlov

GameGuru BOTB Developer

17

Years of Service

User Offline

Joined: 18th Jan 2007

Location: Australia

Profile

Posted: 7th Oct 2018 01:59 Edited at: 7th Oct 2018 02:17

Link

While this is not a showstopper per se, it needs to be raised again.

Currently video playback with sound is not functional in any sane definition of the word "functional".

While I can get it to play full length when exporting to 25fps MP4 (any 29.x won't work), it will never sync with sound to an extent where I could have lipsync dialogues. Real Life cutscenes with talk are impossible right now.

"I am a road map, I will lead and you will follow, I will teach and you will learn, when you leave my sprint planning you will be weapons, focused and full of JIRA tickets, Hot Rod rocket development gods of precision and strength, terrorizing across the repository and hunting for github submits."

PM Email Website

Avenging Eagle

19

Years of Service

User Offline

Joined: 2nd Oct 2005

Location: UK

Profile

Posted: 7th Oct 2018 10:08

Link

While I agree that it's totally unacceptable to have to split audio and video into two separate files and have them play concurrently, I've personally not had any issues with sync. My cutscenes are always 25fps MP4.

My solution to the above problem of sound not playing when spawning on a story zone has been solved by using the ForcePlayer function to thrust them into a storyzone a few units in front of them as soon as they spawn. Because this all happens in the milliseconds before the usual fade in is triggered, it happens in complete darkness, and then the video begins. It's effectively like having a quarter of a second of black before the cutscene plays, which I can live with.

AE

PM Email

Ertlov

GameGuru BOTB Developer

17

Years of Service

User Offline

Joined: 18th Jan 2007

Location: Australia

Profile

Posted: 8th Oct 2018 01:36

Link

Hi Eagle, this depends sometimes on which drivers / audio components are used on the machine you play on.

"I am a road map, I will lead and you will follow, I will teach and you will learn, when you leave my sprint planning you will be weapons, focused and full of JIRA tickets, Hot Rod rocket development gods of precision and strength, terrorizing across the repository and hunting for github submits."

PM Email Website

LeeBamber

TGC Lead Developer

24

Years of Service

User Offline

Joined: 21st Jan 2000

Location: England

Profile

Posted: 8th Oct 2018 10:22

Link

@Ertlov : Did you post this in the Issues Tracker. I imagine there is a way to pull the audio track from the MP4. I am using the 'theoraplayer' and the API code only handled video. If anyone has any links to how they handle the audio side, that would be a big help, thanks!

PC SPECS: Windows 8.1 Pro 64-bit, Intel Core i7-5930K (PASSMARK:13645), NVIDIA Geforce GTX 980 GPU (PASSMARK:9762) , 32GB RAM

PM Email Website

Ertlov

GameGuru BOTB Developer

17

Years of Service

User Offline

Joined: 18th Jan 2007

Location: Australia

Profile

Posted: 9th Oct 2018 00:22

Link

Hi Lee,

I can add that to the issue tracker, I just want to run it through our internal QA first to check if the sync issue is caused by software on the dev machines taking exclusive control over audio playback.

As for the audio asset pipeline, it`s not rocket science to create the mp4 and the ogg for it, just two passes of rendering out.

"I am a road map, I will lead and you will follow, I will teach and you will learn, when you leave my sprint planning you will be weapons, focused and full of JIRA tickets, Hot Rod rocket development gods of precision and strength, terrorizing across the repository and hunting for github submits."

PM Email Website

Avenging Eagle

19

Years of Service

User Offline

Joined: 2nd Oct 2005

Location: UK

Profile

Posted: 9th Oct 2018 09:19

Link

One thing I've noticed with the video player is diagonal tearing.

This is a 1920 x 1080 video playing on a 1920 x 1080 monitor so it shouldn't be a resizing issue. Happens regardless of whether V-sync is on or not.

AE

PM Email

Duchenkuke

GameGuru VBOTB Developer

8

Years of Service

User Offline

Joined: 7th Jun 2016

Location: Germany

Profile

Posted: 9th Dec 2018 18:47

Link

For me there is no sound at all either.

I split the video and the audio but its still silent. I have tried wav and ogg.. ANY Idea what I can do?
The storyzone starts right when the player enters the level.

https://sites.google.com/view/dkproductions/startseite

PM Email Website

DVader

20

Years of Service

User Offline

Joined: 28th Jan 2004

Location:

Profile

Posted: 9th Dec 2018 20:09

Link

@ Duchenkuke. You might try positioning your start marker out the zone then transporting the player instantly to the storyzone? Hopefully you wouldn't see the flip at the start and it may help trigger it. Or, change the code to just trigger when you are near an item rather than in a zone possibly? Some ideas to try.

SPECS: Ryzen 1700 CPU. Nvidia 970GTX. 16 Gig Memory. Win 10.

PM Website

Avenging Eagle

19

Years of Service

User Offline

Joined: 2nd Oct 2005

Location: UK

Profile

Posted: 10th Dec 2018 07:26

Link

Sadly at the moment, you can't start the player on the story zone or else there won't be any audio (no idea why). Instead, place the story zone directly in front of the player start marker, then put a tiny/invisible dynamic object at the foot of the start marker and assign it the following script:

+ Code Snippet

function forceintro_init(e)
end

function forceintro_main(e)
PlayerDist = GetPlayerDistance(e)
 if PlayerDist < 50 then
  ForcePlayer (0,10)  -- (angle, force) tweak these as appropriate
  Destroy(e)
  ActivateIfUsed(e)
 end
end

Play around with the angle and force coefficients to get the player pushed into the story zone in the first few frames of black when the level begins, before the fade in. Your video should now play with sound.

AE

PM Email

DVader

20

Years of Service

User Offline

Joined: 28th Jan 2004

Location:

Profile

Posted: 10th Dec 2018 09:51

Link

@ Avenging Eagle. It probably works but the transport method I mentioned is a far easier and more reliable way to do it. I just tried and it works fine. No messing with angle and force here just a simple transport as soon as you start the game. You do not see the initial position.

+ Code Snippet

function transporttoitem_main(e)
 PlayerDist = GetPlayerDistance(e)
 if PlayerDist < 200 and g_PlayerHealth > 0 then
   TriggerFadeIn()
   TransportToIfUsed(e)
 end
end

Just add this code to any item (make it dynamic), place it close to the player start marker (away from the storyzone), add an item in the storyzone. Grab it's name and then add that to the if used section in your first object (near the player).

SPECS: Ryzen 1700 CPU. Nvidia 970GTX. 16 Gig Memory. Win 10.

PM Website

AmenMoses

GameGuru Master

8

Years of Service

User Offline

Joined: 20th Feb 2016

Location: Portsmouth, England

Profile

Posted: 14th Dec 2018 10:21

Link

Alternatively you can use global sound like this:

function storyinzone_init( e )
    g_storyinzone_mode[ e ] = 0
    LoadGlobalSound ( "audiobank\\folder\\sound.wav", 1 )  -- change to your own wav file
end

function storyinzone_main( e )
    if g_Entity[e]['plrinzone']==1 then
        if g_storyinzone_mode[ e ] ~= nil then
            if g_storyinzone_mode[ e ] == 0 then
                g_storyinzone_mode[ e ] = 1
                HideHuds()
                if radar_hideallsprites ~= nil then radar_hideallsprites() end
            elseif
               g_storyinzone_mode[ e ] == 1 then
                PlayGlobalSound ( 1 )
                SetGlobalSoundSpeed ( 1, 40000 )   -- tweak this to synch sound with video 
                PlayVideo( e, 1 )
                g_storyinzone_mode[e] = 2
            elseif 
               g_storyinzone_mode[ e ] == 2 then
                if radar_showallsprites ~= nil then radar_showallsprites() end
                ShowHuds()
                Destroy( e )
                ActivateIfUsed( e )
                g_storyinzone_mode[ e ] = 3 
            end
        end
    end
end

+ Code Snippet

function storyinzone_init( e )
    g_storyinzone_mode[ e ] = 0
    LoadGlobalSound ( "audiobank\\folder\\sound.wav", 1 )  -- change to your own wav file
end

function storyinzone_main( e )
    if g_Entity[e]['plrinzone']==1 then
        if g_storyinzone_mode[ e ] ~= nil then
            if g_storyinzone_mode[ e ] == 0 then
                g_storyinzone_mode[ e ] = 1
                HideHuds()
                if radar_hideallsprites ~= nil then radar_hideallsprites() end
            elseif
               g_storyinzone_mode[ e ] == 1 then
                PlayGlobalSound ( 1 )
                SetGlobalSoundSpeed ( 1, 40000 )   -- tweak this to synch sound with video 
                PlayVideo( e, 1 )
                g_storyinzone_mode[e] = 2
            elseif 
               g_storyinzone_mode[ e ] == 2 then
                if radar_showallsprites ~= nil then radar_showallsprites() end
                ShowHuds()
                Destroy( e )
                ActivateIfUsed( e )
                g_storyinzone_mode[ e ] = 3 
            end
        end
    end
end

Been there, done that, got all the T-Shirts!

PM

Product Chat / Video plays with no sound