![Movie Movie](/uploads/1/2/5/3/125364200/588145989.jpg)
EDIT: For the sake of closure on this Reallusion did not offer up any advice or solutions to this. Not really an issue but Stand Sure Studio (my company) solved this. We are still using iClone7/3DXChange7 for the animation tool of choice. We love it even though it has some really strange gotchas and 'what really?' Type stuff in it.
I decided we need to treat it exactly the same as we do with the game engines.just do things that are already in place and not going to break something (a thumb in the eye of Unity 5/2017/2018 here). So that is what we did. The original TL,DR below is still 100% valid and will cause a lot of headaches. Read about it here (the great news): ORIGINAL: Hello All.
Some know me here (especially on the CC3 Beta side). Warm Welcoming Wave to you folks. Sorry.No TL R version. Not really possible.and if you are not interested in reading and seeing the underlying issues in this software platform then simply move along.
Cannot help whom don't want help/info. I am typing this (on a Sunday morning.4.5 hrs total) at the benefit of all who really want to know before (or after) sinking $1,000 US plus into a Real-Time Rendering Pipeline (which means a Game Engine or Motion Engine using 'A Pipeline'.take your choice).I put the Unity Tools we use at the bottom of all this.excellent tools. Unbiased Opinion and Known Workflow Facts: Okay.so first things first. I am a self funded game developer. I have a few employees and we are doing what we can to make a framework that will be at least a 10 year venture to handle all the game play.this includes animations and a lot of standardization. IClone7 (iClone5 originally) was supposed to be this software to handle ALL standardization of animations on a consistent skeleton. This would help Modders as well to build and adapt animations to the game engine prepared through a specific Unity Asset Bundle.
Motion Capture File Formats Explained 4 For the remainder of this section both the BVH and HTR file formats are examined in more detail, which includes an explanation of both the formatting of the file and the processes needed in order to.
At least the process does. IClone7 'Appears To Work' but has some serious issues when it comes to Real-Time/Game Development. The information/pics shown below is valid up to: November 18, 2018 (relative to all iClone7 and 3DXChange7 versions.as far as I can tell) We noticed this issue in mid October and took us quite awhile to solve where the issue is actually coming from. Not certain there will be an easy fix for this either.maybe RL will magic wand this but I doubt it. I did make a Reallusion Feedback Tracker on the 3DXChange7 conversion issue.but I think the issue is more systemic than that since our company viewpoint is based upon many underlying issues. DAZ G2 Male and Female Shoulder Conversion Issue Here is my first Reallusion Forum Post.which is an Unbiased opinion of iClone7 Pipeline (and also CC2 at the time). I really do like the iClone7 software.
Easy enough and looks good (the team likes it as well). It is in fact the small things iClone7 and 3DXChange7 does that just stomach punches my team then kicks us in the teeth. This software is not inexpensive ( Pipeline and to get the Most out of it needs paid addons with Export Versions) but if a software like this works then it saves time and makes animators and us happy. So I would happily buy Pipeline Licenses for all computers at the office. Reallusion's loss here. For why I do not add CC3 here as well.well here are a couple Youtube Videos from a really solid guy that sums up all the screen shots and words I can type perfectly. CC3 is simply a cool showcase and perhaps characters to be rendered within iClone7 but definitely not game ready pipeline production ready.
There are many issues that need convoluted workarounds to get CC3 to work properly in any game engine. We said it in Beta and I'll say this again.CC3 is just not ready for Prime Time. However, Reallusion is not my company and they can do whatever they want.
Reputation is paramount though.and this Real-Time Visual Book Developer (Me and my team) will not Help or Recommend iClone5/6/7 for any other Game/Real-Time productions. We have some excellent workflows that I could share if fully integrated into this software suite to help others. VirtualRealities.school has some great videos with lots of various workflows and really solid opinions on lots of character platforms as well.
Well worth watching for anyone wanting to do Real-Time Animation and Rendering in Unity (similar workflows into UE4). Give this guy some likes. Character Creator 3 has finally arrived: First Impressions: Character Creator 3: Using LODs and Merge Materials in Unity: And a great RL Forum Post on CC3 to Unity Workarounds as well as a number of Underlying Issues encountered: (We are not the only ones =) ) Our workflows differ a little on the CC3 side of things but all in all.Apples to Apples. What is really important to note about CC3 is that ONLY the expression Blendshapes are exported and usable in the Skinned Mesh Renderer.
This means that changing Blendshapes must be done in iClone7 and cannot be done in a character system within the game engine (of choice). This is hugely problematic since most modern 3D Character Systems at least have some facial adjustments at character creation. To compensate for this various versions must be made and selected. Older MMOs do this sort of thing (GW2, LoTRO, SWTOR.etc) but more modern (2007+) RPGs (Mass Effect, Skyrim, Fallout4.etc) allow some facial and body customization. So for a Very Modern 2018 CC3 not to behave 'More Like' DAZ Studio in Exporting Blendshapes is just.WTF? I mean.Reallusion tout themselves as The Animate Your DAZ Genesis Characters company.and we end up with CC2/3.
Software Versions: So why this post anyhow? 1 - To learn from our mistakes when using a software platform like this. Just open the eyes a bit and look more deeply than just the various iClone6/7 videos showing conversion and easy animation processes. It is indeed easy but once you actually take this software into production the real issues surface.
These are not small/minor issues. 2 - To give Reallusion some sort of public feedback on using their software in Actual Production. We are actually trying to use this as a seamless tool to Unity 2018 using Humanoid Mecanim (issues in UE4.20 as well.related). We also do contract work in UE4 and had to manually fix a lot of issues once exported from iClone7/3DX7.
So why on earth use a software that does animation only to have to fix the animations once exported to resolve issues with skeleton transform issues? Here is what set this to action.after our happy team had more than 1800 animations (about 70%) processed and converted into iClone7 (we also fix animations before adding to iMotion Libary). Now we started exporting FBX (Individual Files) and importing into Unity (2018.2.14) and applying iClone7 animations to our Animation Controller.
We noticed something with the animations that just seemed a little off. Not much but 'Just Off'.they just do not 'Look' like they do in iClone7.and this is what we found. We have a Custom G2 Female and Male (both are 32k tris) that has been Re-Rigged in DAZ to the G2 Skeleton (G1 and G2 both animate the same in regards to Real-Time Engine).
So basically our G2 Female and Male are deemed as 'Clothing' that attached via the Clothing and Attachments system I made in Unity. This system works flawlessly for LOD and Animation. Also will give Modders really easy Body/Clothing features later. The bodies do not have Blendshapes (faces do though) but there are a number of them that are selectable in the character menu (Guild Wars 2/LoTRO/SWTOR.etc do similar). So we thought.perhaps this is the issue? - We also tried a Default G2 Female (with the same Blendshapes Baked into the mesh.Apples to Apples Comparison).
Here is the G2F 'Clothing' showing the rig in DAZ 4.10 Pro. This is in the Default G2 Female Pose in Lieu of our Custom Fitting and Animation Pose. To iClone7 via 3DXChange7 process (2011 Binary is per the Reallusion Videos.same results are attained via 2012, 2013, 2014 Binary.but since 2011 is stated as supported we stick with this to iC7) Here we see the import results into 3DXChange7. I guess this has always been this way through all 3DX7 versions. Perhaps even in older versions. All the animations are using this same model in iClone7 to animated from (Standardization). You can also see here the T-Pose has been converted to the iClone7 iAvatar Format so it behaves like a CC# iClone# character/avatar.
This is fine since we are ONLY interested in Standardized Animations. Here you can see our Custom Character has been Converted and Posed in iClone as an iAvatar. This is what we use to animate everything. (1 Female and 1 Male). Again we are using a 'Fit' and 'More Muscular' character so the animation spacing works correctly for the other body styles as well. You can see here the Shoulders (feet have issues too.but much more common) do not look bad at all.really easy to miss. Especially since the animations are all done zoomed out looking at the full model for most things.
The next picture will make it absolutely clear where the issue is. Here is what is happening in Unity. This is just a standard new Unity project to make certain nothing is interfering with the process. From the Unity standpoint all clear.meaning no bugs in the Rig Button and Mecanim. The Right figure is the DAZ G2 Female with Morphs Base Resolution (Blendshapes) baked into the mesh (not changeable in Skinned Renderer) The Center figure is our Custom Clothing G2F (it has separate pieces as well.not just 1 mesh with multiple materials) The Left figure is the DAZ G2 Female after coming from 3DXChange7.
We are not interested in the Mesh here.we are interested in the Animations from THIS skeleton.meaning ALL the transforms! All three left arms have been rotated to 75.0 degrees to illustrate why the Animations and Skinning are an severe issue. To add to this.any Breast Bone animation is lost during the 3DXChange7 conversion process. So any custom animations done in DAZ Studio with Graphmate and Keymate then imported into 3DXChange7 the breast animations are lost. There are no controls for the Breast Bones (great for Female and Male by the way) in iClone7. So where did the bones go and why is there no support for this.
At worst case provide the Blendshapes for export so they can be moved by 'Jiggly Mesh' which has it's own issues but at least possible. Nope.neither option. No way to fix this one either.the bones are simply not there. Another rather large issue in using iClone7 is that if you load in your Blendshapes (morphs) for DAZ Genesis 1/2/3/8 Export and bring that directly into Unity/UE4 you will see them in the Skinned Mesh Renderer.
Now import this DAZ 1/2/3/8 character and have 3DXChange7 convert it to the iClone7 iAvatar Non-Standard Character. With iC7 Pipeline I have prepared these characters with the RL DAZ Extension which sets a pose and adds animation to the timeline. This all transfers perfectly so facial animation can happen in iClone7.with say Reallusion's facial and mocap software (paid addons). Great right!? Say you do all your facial animation and body animation and decide to Export your characters out of iClone7 and into your Real-Time Rendering and Animation Software (ie Game Engine) to make Real-Time Movies/Videos/Games.and we then get the character(s) set up and ready to connect in the Blendshapes for.hmmm.only the Expression/Phonemes are in there.
Where did all the other Blendshapes go? Scour through docs.videos.waste more time.hmm.no mention.
So what Reallusion simply does not tell us is that Yes they Support DAZ but ONLY the Expressions will be included in the FBX Export Pipeline from iClone7/3DXChange7. Yeah.they support DAZ but only as converting them to iAvatar which seems to strip everything out of the original FBX. I guess in hind sight.expected? Still this is not explicitly stated anywhere.especially on or near the purchase option on Reallusion. Here is what you need to know prior to purchasing.explicit right?
Nope.not even close. So basically.purchase and figure all this out the Hard Way.like we did. So our only option with iClone7 is simply do animations. And now.we cannot even do that. What are we left with now? A MASSIVE time sink into a software that we can no longer trust. It updates often and the nuances between these minor version slew bugs around to different spots.
Again, this software pipeline looks and feels great! Easy to use and does some amazing stuff to make animation easy. For Unity there are a couple of alternatives that we are in the process of using/fixing all iClone7 (70%) and the rest.perhaps even scrapping the iClone7 animations since we have to fix them and just fix the originals to our ' G2 Skeleton' system and make new animations that we made in iClone7 and that are still on our list. Tools we are using to Great Success Now (To bad for UE4): Lip Sync Pro: assetstore.unity.com/packages/tools/animation/lipsync-pro-32117 Amazing Tool for Blendshape Animation and Audio Lip Sync. The Eye Movement Controller included is very well done. Of Note CC3 characters lip sync really well with this tool.
Very Animation: assetstore.unity.com/packages/tools/animation/very-animation-96826 This tool works a lot like iClone7.meaning even I can use it. =) UMotion: assetstore.unity.com/packages/tools/animation/umotion-pro-animation-editor-95991 I have to admit this tool is waaay over my head. My animator likes it for some things but also mainly uses Very Animation to do the 'heavy lifting'. This tool offers Maya/Blender type of tooling.
And that is enough. We at Stand Sure Studio have 'Had Enough' of a beating from the iClone7 Suite of Software. We are done with this nonsense. We are bitter. This was truly a painful and time consuming process.
Reallusion really let us down with this. Originally is was iClone5 but we quickly found out that Pro would not do what we needed but also the software just was not capable 'yet'. IClone7 is indeed capable but the beating we have taken on this is just frustrating. I get it.we get it.especially my college girl gets it. No 3D Animation Software is perfect.we have to learn to use a variety of tools to make things happen. IClone7 is one of these suites that looks like it will solve/smooth a very nice pipeline.even their In & Out Suite is named aptly 'Pipeline'. This Pipeline must work though.
Start to finish. If it breaks down in the middle it is no longer a Pipeline. On the UE4 side of things for our contract work we are still investigating a good workflow to use Unity 2018 as the Animator and export this to UE4.
Looks to be very possible. Working in tests.but definitely not automated. I will not hand out the workflows on this either.so do not bother asking.
![Movie Movie](/uploads/1/2/5/3/125364200/567038189.jpg)
=) Sorry.have to have some proprietary secrets. =) My hope is that Reallusion does take some REAL time to sit down and ACTUALLY make a Pipeline Workflow that does more than just having Kai slap through the process (great videos Kai! The stuff we are talking about here is down deeper and needs to be seriously analyzed. I believe this to be very fixable if due analysis is taken. Yes this takes time but the end result is.well.happy customers that purchase your software suites then tell others to do the same.
So do yourself a favor Reallusion and get your workflow issues for Pipeline 'worked' out. You lost a previously pleased customer here but perhaps future customers will not have to go through this mess. Also remember that you are actually competing with Unity, UE4, Lumberyard.etc for Real-Time Rendering Movies/Videos and DAZ Studio (primarily) for a Real-Time Rendering HD Quality Character Creator System. So get your software right! Cheers Don Anderson (aka Olander) Owner/President Stand Sure Studio. A truly sad story. I start to understand that game dev animations is a hard egg to crack.
I am about to begin my own story with RL next year. Got a indie game company. And I plan to do character and mocap animations with CC and iClone and export to FBX to use in a Game maker studio 2 game. But I wont use Daz or other software and go back and forth with the models. The plan is to stick with RL software and models and maybe go a bit outside with Zbrush, but thats it.
After hearing your story, it is however a bit scary to put $2000 into this basket. IClone 7, 3DXchange 7 Pipeline, CC3 Pipeline, CT8 Pipeline, Iray, Live Face, iPhone Xr. Thanks @Peter (RL). We really do love iClone7 and 3DXChange7 so hopefully you folks can figure this out (we cannot wait). DAZ G1/2 is not a new skeleton so either this has been the case for some time or something new in iClone7.# @The-any-Key Actually these Game Engines are much more now than the old days of very specific proprietary tools.
Both Unity and UE4 handle animation re-targetting amazingly well.they have some really talented people who know how 'bones' are supposed to animate within their ecosystem. Then top on all the yummy frosting on how fast and good they are at rendering from Toon to HD and the mouth drops open to gawk at. They do require lots of various skills to use though.some easy.but 3D characters are a pain in the arse. DAZ G1 and G2 both use the same skeleton so they animate the same (they animate really well.much better than G3 and G8.
CC2&3 both animate really well too). We use G1 for creatures and special race characters and G2 F & M for the human/elf/halfling characters. Since we need the facial blendshapes in Unity (and UE4) for most characters there is no going back and forth. We have the OBJ meshes in Blender that we are using like ZBrush. We get the seams exactly where we need them and the UVs settled then import back into DAZ Studio to be Auto Rigged and Skinned to the G1/G2.now they are essentially fully rigged clothing items.
Hugely beneficial because now these models can use the amazing DAZ tools to fit clothing and all sorts of items too.CC3 does this same thing via the OBJ process so this is a really good ecosystem process as well. I guess the main thing is.we are agreeing.very little back and forth. Even though our team is bitter about this.iClone7 Pipeline is an awesome software ecosystem. If going the ZBrush to CC3-iClone7 route then just make certain to check your model BEFORE and AFTER the 'iClone7' process so you don't end up like we did. If we would have done this test originally we would not have lost all the time and frustration. That is the point of this entire forum posting. Just make sure your workflow matches on the In Side and Out Side in lieu of simply assuming Reallusion's tools have been thoroughly tested to automated goodness.
Side note.we purchased Akeytsu after watching their tutorials (and a couple of Vidi's videos.awesome Great work @Vidi). Amazing tool and really easy animation, rigging, and skinning.very polished and works perfectly.
Their QC is amazing. It does not carry blendshapes yet on the FBX but for $180 US it is inexpensive and good to support their company! Our animator likes it so it is a nice tool to create animations from scratch. Since I am a code and system tools guy I will stick with the in Unity tool Very Animation. I still think CC3/iClone7 could be the character creator for everything 3D Motion related once RL gets these things worked out.
@AutoDidact Read the entire thing. =) Thanks for the reply and great to have a dialogue.
I had my animator read it as well. You are well respected in the DAZ and RL forums.
Actually I am surprised you are now using G3. =) I actually have to disagree with you about the RL testing the In and Out of the model/animation. =) Not you have that happen before right? When the model is Auto Detected as a G2 (in this example) then those scripts need to be set up so that bones are in the same places when converted. As example Unity's Mechanim and UE4's Skeleton Tools don't change the bone mapping transforms. They are perfect.
So there is no excuse for 3DXChange7 to change the shoulder area bones when remapping to RL-CC# skeleton. So indeed this is an issue.
Our Out methods go in different directions so perhaps that is part of the difference. Again, great to have the dialogue. We don't use DAZ Studio for animation.for a few things we start with poses over a couple of frames then blend the poses in iClone7. This gives a great visual of where the animation is supposed to flow. I have both Graphmate and Keymate in DAZ which are really the needed if any type of animation (AniBlocks/Timeline) are to be done.
You stated so yourself in the DAZ forums. We found DAZ Animation to work but is really interesting when exporting. Also the animation files really need a lot of cleaning (my animator and other sources explain this as well). So we simply just do the start-middle-end poses and export those.
You are using the BVH technique which is really slick.but our motion engine is Unity. It is a hybrid Game/Visual Book with (7) 67km2 maps all with realistic weather, wind, day/night, fog.etc.all in real time. So framing in a movie via a rendering capture system is not going to work. Side note is to capture video we actually use 1920x1080 PNG at 30 or 60 per second then combine them to render a video from the in game camera. Before all of this CC2 and CC3 stuff (which is another reason why I purchased iClone7) is to see if there is a different 'Standardized Skeleton' we can use to run all of our animations on in lieu of DAZ G1/G2.
We have Mixamo, a few Unity Asset Store, Maya LT HumanIK, and now our iClone7 customs & converted. I am not an animator but I hired one and what we did find is that DAZ G1&2 and CC2 skeletons all animated great in Unity and with a little extra work in UE4 as well (CC3 now makes UE4 a snap).
We had troubles with DAZ G3 & G8 because of the intermediary 4 new twist bones that re-targetting systems really have trouble with. DAZ would not work either.I guess until this new 4.10 version.which we never went back to check animations as well. Thanks for the info! So we actually REALLY want to use the CC2/CC3 skeleton and framework.
I am awesome at textures so the new CC3 textures did not phase me at all. My college girl hated the CC3 Male's feet (terribly modeled!! That lad needs some serious surgery. =) ) but overall we were both on board with CC3. LOD issues could be manually managed out of CC3.
It could work.the killer of CC3 is, blendshape naming of the expressions and phonemes, and then no facial shaping blends being exported. So RL definitely has the tech to export blends in the FBX export but no other shapes.with zero explanation as to some reason not to. We really only need about 25 facial blends to give some customization. Lip Sync Pro does really well with CC3 so facial voice animation is smooth as butter. So we were left with a tough decision.fix CC3 after export in Blender to add facial blends or stick with DAZ G1 & G2. We did a side by side animation test and essentially they are equal.so we stuck with DAZ.
And thusly.we never noticed the shoulder conversion issue until the bitter rant above (the nude DAZ G2 model shown in the pictures is already broken with the 3DXChange7 import conversion.which changes the transforms). The one thing we did note in our workflow is that once we leave DAZ the model does not return (outside of the initial re-rigging of the model OBJ from Blender). And a little side info.we did a test on CC3 with a slew of our animations in iClone7 and as expected there are no shoulder glitches and the skeleton re-targets in Unity's Mecanim just fine. I knew this would work too based on all of our CC3 Beta dedicated 'Hard-Core Break the F-ing' thing testing we did for RL. We hammered the heck out of it in every nook and cranny for a workflow for a Real-Time HD Motion Engine (Unity/UE4/Lumberyard/Godot all tested). We know where it will break and what we have to do to get it to work.
We liked it and the iClone7 workflows. At the end of all of this we are discussing as to whether simply making a metric ton of head/face templates then selecting them via a slider (MMOs do this as mentioned above).
Not the first time this has been discussed but now this is serious with all the animations already converted in iClone7 and many exported to Unity. I can change the tools easy enough and it does simplify things on syncing up the blends so the vertex don't hiccup during frame shifts during heavy loading. Perhaps it may be the better option in the end. We all love iClone7 and how it works.so we are discussing. Sheesh.I type fast but another TLDR opportunity.
Tough topic to be shallow text on though. Thanks again for great info. Hi Thanks for taking the time to share all of this detailed info about your animation pipeline.I hope you get your remaining major hurdles sorted ASAP. I admit that alot of your process is wayyy over my head not being a game dev myself,But I am always fascinated to hear detailed descriptions of the multi application,character animation pipelines of others as they always present opportunities for me to learn something I have been watching the development of the Character tools for Unity such as Umotion and Final Ik etc with great interest We have so many options today. A very exciting time indeed!!!
RagingKylo (5/22/2016) Really? Convert them one at a time or batch convert? You can only convert one motion at a time in 3DX, as R2 Studio mentioned, I found it's best if you can find a T-pose from the same source if possible and convert that first and save as a 'T-Pose and Profile' for the rest of the conversions. However some bvh captures will conform to other base T-Poses that came with 3DX, if not find the tutorials that show how to set a proper T-Pose in 3DX.
This part is important and will make or break your attempts for a fluid.iMotion in iClone in my opinion. The only time I don't use a T-Pose is if I just want a pose instead of an animation.