Blend: Character Engine powered by AI

Hi @tronbot, actually there are no missing details. Our project is related to developer tooling, hence do not specially deploy a smart contract for any features. The project website is included in the GitHub and demo link, but in this case, I will separate it out. The project milestones are in the project description with the current hackathon progression.

1 Like

Spend a whole day running through your deep learning pipeline and it is really impressive in terms of the reconstruction quality~ Good job with the detailed project description, I really like your way of preparing the explanation diagram.

PS: Oh, and you have the coolest demo video I watched so far from the submissions. Really put in a lot of effort lol

After reading the github and watching demo videos, it really inspiring and amazed me despite of the graphics of the game , 3D face, the pipeline of constructing the 3D face and the effort paid on the demo videos. May I know what is the pre-requirements for the selfie image to be rendered before it is fed into the engine and creating the 3D faces ?

If this right here does not win the best intro ever in the hackathon then i dont know what else would.

This is such a great project and i really appreciate the effort the team is putting into getting this thing done.

Aside the facial reconstruction are there any plans to expand it to body reconstruction too.

Some of us have physiques that are much heavier than Arnold Schwazzeneger in his prime and would love to see that as a character in a game.

Nice intro video. I think this should be adapted to BTTC as well since games are more likely to go there due to the low gasfees.

Thanks @forestpoint~ Hope you gained some inspiration on AI-based Tron DApp or any AI-related knowledge from our project.

Hi @wsw1833, basically we dont have a specific pre-requirements for the selfie image which is uploaded by the user as our deep learning pipeline (as well as our image preprocessing pipeline) do designed in a way that we can deal with different kind of selfie condition. This includes extreme illumination difference, occlusion, low resolution and blurred capturing. However, yes, this will somehow slightly affect the accuracy of the predicted reconstruction. Hence, we request user to submit a selfie which has clear resolution, white background, no extreme lighting condition and also in a correct ratio.

1 Like

Thanks, @Nana66419~ our research team is happy to hear this, I’m very sure! The intro is indeed a Unreal Engine showcase demo which our team built in order to demonstrate how game developer can use Blend when building their metaverse or on-chain game. And this impressive result is what Blend can help a game to achieve.

Currently, full body reconstruction is not in our future milestone as our research team hope to first focusing on coming out with a complete pipeline which can deal with complete head reconstruction, ultra-realisitc hair strand and also auto rigging attachment. Plus, currently our vision is to perform post skeletal mesh fusion, which in other words is to merge our reconsturcted human head section with the GAME CHARACTER BODY prepared by the game developer. Why we set our vision like that is because we hope that we can leave the body part to the game developer in order to reach a maximum flexibility for the game provider and will not limit their creativity.

However, your idea is very good as our team do raised out similar thoughts before during the R&D process. Which is involve in body reconstruction, and at the same time transform the game character body into a so called “dynamic fluid form” to fit the player real life physiques. So yes, we hope that we can reach this state in the near future.

1 Like

Thanks @fabsltsa, happy to hear that you are impress by the video~ Definitely a good suggestion to expand the use case onto the BTTC network as currently the gaming ecosystem on BTTC is not so mature yet and is a good place to create a gaming era there. In this hackathon, we will focus on Tron network but definitely will have it on BTTC soon.

I see, thanks for answering my question and hope all the best to you! :star_struck:

1 Like

Sure. For the moment Tron ecosystem is way more alive than BTTC but due to the high fees on Tron dapps are more likely to move/build to BTTC, especially Games that often require tons of tiny tx.

2 Likes

I have watched the video. Such a great concept

I want to try this, your website directed me to your github…

are you a game developer?

Hi @Prince-Onscolo, as our project is an AI-related developer tooling and infrastructure, hence, you need to utilise it on a blokchain game project in order to see its full potential. Plus, our face reconstruction pipeline needed to be setup on an AWS instances (basically virtual machine) in order to run it due to the computation resources demand.

However, our team just planned and will be soon releasing (in this few days )a friendly executable file for everyone to download into the local computer and run the face reconstruction pipeline (without setting up all the tech environment). Although a local executable could not test Tron related features (for that, you need to host our current GitHub repo which have Tron stack integration), but everyone can have a try on the most interesting AI part.

So, do stay tuned as we will update the community soon, in this post! Thank you

1 Like

I’m one of the member from the Blend Research Team, and we are a team of computer scientist from one of the university CS department in Malaysia. But our team members do have related experience in Unreal Engine development, that’s why we are able to introduce an automated pipeline in this scenario.

1 Like

Thats very good, i wish you all the best as i see this to be one of the best projects this season has to offer especially to us game lovers.

This will really help, I was thinking of that. thanks for the explanation

Thanks @Nana66419, happy to hear that! If you’re interested in our project, do show us your support during the voting period as this will really mean a lot to our research team. Thanks~

1 Like

You’re welcome. Once our Python-based executable is up and running, I will let you know~ Thnaks @Prince-Onscolo

1 Like

Alright, waiting patiently

1 Like

Hi @blend

This project is super neat and very forward thinking in terms of the future, great to see this type of project for the S5 Hackathon!

Interested in the concept of Blend’s NFT Passport for achieving interoperability. Do you mind providing more details on how this passport, a TRC-721 token, binds with 3D files on BTFS?

Additionally, how does it facilitate the retrieval of related 3D files from decentralized storage, enabling users to transition seamlessly between different games built using Blend on TRON?