Photoface™ 3D is a SitePal® feature that enables you to create your own 3D character from a photo. To access this feature, open the SitePal Editor, and in the ‘Models’ tab click on ‘Create Your Own’.

Photoface 3D is available with the Gold Plan & higher

In this post we would like to share best practices and tips that should help you make the most of this unique feature. Getting good results with Photoface 3D is partly due to optimal photo selection, and partly to acquired skill with the creation process. We will discuss both.

I. Photo Selection Tips

Your first rule – pick photos that meet our guidelines –

  • Mouth closed (no teeth showing) – smile is ok
  • Face looking forward, directly at the camera
  • High quality, hi-resolution photo (more about this below)
  • Evenly lit & in focus – no shadows on the face
  • No eyeglasses, hair or other obstructions over the face. Facial hair should not be a problem.

High hair (a bun or Afro for example) can cause problems and should be avoided. Long flowing hair should not be a problem.

Optimal Resolution

So what is the right resolution to use?

Use a low resolution image – and your character may appear pixelated (grainy) when displayed on your web page. Use too high a resolution – and you’d be adding weight (download size) to your character unnecessarily.

The rule of thumb is roughly 1000 x 1000 pixels for the area immediately surrounding the face (while the photo itself may be larger). There is not much value to be gained by using a higher resolution, because on most screens it is unlikely that that these extra pixels will come into play. But if your implementation has unique viewing characteristics, do the math & decide for yourself.

Image Composition

We suggest to use a photo that displays at least the upper part of the body, not just the head. For best results the body should be visible from below the chest & up. This will allow you to create a character with a large enough portion of the body, which will enable more flexibility when positioning on your web page.

Background – does it matter?

The Photoface 3D process does a pretty good job identifying the persons’ outline & auto-removing the background. But having a complex, noisy background can sometimes cause problems. While we do not require it, if you have the option we encourage the use of a uniform color background in your photo.

Pre-Edit the Image

Being fluent in Photoshop can be an advantage in certain cases. For example – a short neck (or no neck) photo can cause the shoulders to animate when the face moves. Sometimes that works well, and other times not so much. In those cases editing the photo by adding or extending the neck can help resolve.

Another example is the so called “high hair” scenario. In some images, the face might be slightly inclined forward, resulting in the upper scalp occupying a bit more of the vertical length of the face than it normally would. This can result in visual problems when the Avatar animates. Sometimes it can be addressed by adjusting the Camera Angle setting (see below). But it can also be improved by trimming the upper scalp. This phenomena can exacerbated when the face shape is long and narrow.

A long narrow face can result in “high-hair” distortion – slight trim of the upper scalp may help

Special Cases

Note that a photo may not work very well despite satisfying all requirements. Sometimes it is best to simply select a different photo. The opposite is also true – we sometimes see great results with faces that are off center, looking slightly sideways, or wearing eyeglasses.

Photoface 3D technology is optimized to the proportions of a “normal” human face. Faces with unusual proportions may not work very well. For example – an alien face with exceptional large or protruding eyes.

Despite that, we sometimes see customers achieve surprisingly good results with images of inanimate objects. A customer recently shared with us a very lovely “carrot face”, created by anthropomorphing an image of a carrot. We encourage you to use your imagination – but bear in mind that the tool was designed for human facial proportions.

Example of inanimate image that works nicely

II. The Photoface Editor – Suggestions & Tips

When you click on “Create Your Own” and initiate the Photoface process, there are 4 steps to go through:

1. Image upload & positioning

2. Anchor points placement

3. Masking the image

4. Finalizing your characters’ settings

Step 1 – Rotate & Scale

In the first step, your uploaded image is scaled and positioned automatically. Treat this initial positioning as a “first approximation”. It is up to you to fine-tune it.

Rotation: be sure to position the face with the eyes horizontally aligned. In some photos the mouth and the “eye line” are not parallel – your priority should be to align the eyes. The mouth can be fine-tuned later.

Scale: As you position the photo in the frame, you may want to zoom out a bit, to allow more of the body into the frame. This positioning determines your final character’s visible extent. If the body is cut too short it may limit later positioning on your web page.

Make sure the eyes are horizontally aligned, adjust mouth later

Step 2 – Anchor Point Placement

In the second step we auto-position the anchor points for you based on facial image analysis. This should also be considered an “initial approximation” for you to review and edit.

Follow the positioning in the sample picture & adjust the points carefully as needed. The auto-placement frequently requires manual fine-tuning.

Sometimes initial point positioning is off – always check and adjust

Step 3 – Masking the Image

We recommend going with the deafult settings in this step, unless you have good reason not to. Automasking works well in most cases, and produces better results.

Step 4 – Final Settings

In the final step, detailed tools are provided to help you get the mouth just right. Try them out repeatedly, until you get a good feel for how each setting affects the result.

For example, you may need to extend the mouth slit – not too wide, and not too narrow, to enable the mouth to open naturally. You may need to position the mouth slit off center & play around with its curvature and vertical location. Faces are never symmetrical.

Check out the slider for teeth whiteness. Avoid teeth that are too bright – a good rule of thumb is to match the whites of the eyes in the photo.

The “Camera Angle” setting can be very helpful. Play around with it to get a good feel for its effect.

Many times a face appears perfectly natural in the photo, and it is not immediately obvious that the photo was taken from slightly below the facial plain. This may cause the upper part of the head to stretch unnaturally as the head moves & can be a particular problem with naturally elongated faces.

Adjusting the camera angle can compensate & resolve.

Comments? Questions? Send us a note to: support@sitepal.com

We’ve just completed our first 3rd Party Text-To-Speech integration – with Google Cloud TTS leading the way. This integration adds 284 Google voices to SitePal. 

Before proceeding we’d like to make clear:

  • Using the new voices requires integrating your Google Cloud account with your SitePal account. This is done by adding your Google API key to your SitePal account’s “Connect” page. This is not difficult and requires no coding.
  • Thus the cost of generating the Google voices (if any) is borne by you, and not included in the SitePal subscription cost. Please bear in mind.
  • 3rd Party TTS voice integration requires the SitePal Platinum Plan.

The integration covers Google’s Standard, Wavenet & Neural voices. For a complete list of the added voices, see our API Reference – see Engine 11 in Appendix B.

To try out the newly added voices, see:  https://cloud.google.com/text-to-speech/docs/voices

Note: some newly added Google Voices might not yet be available in SitePal, we’ll be adding those periodically.

Google voices can now be used in SitePal just like any of our built-in voices. The new voices can be used either Statically or Dynamically. 

Statically – created using the UI in your SitePal account, and then assigned to your Scenes.

Dynamically – real time via the SitePal API. Response times and performance are excellent. 

Google TTS Voices

Tips: 

  • If the audios that your avatar will speak are known in advance, it would be best to manually create, name & save the audios in your SitePal account, and then use the “sayAudio” API call to invoke speech dynamically (as opposed to using “sayText”). Doing so means that we will not access the Google API at runtime, thereby saving usage costs. 
  • Separately – it’s worth noting that SitePal caches dynamic TTS and if an audio is frequently used it will likely be delivered from the cache. This optimization is built-in – you don’t need to do anything to turn it on.

We’re working on integrating additional 3rd Party TTS providers, with AWS Poly, MS-Azure and Eleven Labs next on our list.

Last but not least! – we’ve recently introduced great new Robotic characters, available now to all SitePal plans. Check out our entire collection here: www.sitepal.com/collection

New Robot avatars. Each of them has several alternates.

Stay tuned for more updates… 

Warm Regards,

The SitePal Team

www.sitepal.com

What does your site say?”

Hello SitePal Fans!

With recent AI technology advances, we’re seeing the long sought after vision of a “Virtual Doctor” come closer to reality!

While a virtual healthcare professional is a prominent (and much needed) use case – this has enormous potential which is not limited to healthcare. The gap between available services and the public’s ability to take advantage of them is growing in every industry. With available options growing or changing by the day, it is likely that your customers cannot effectively understand or use your products without talking to someone.

We recently implemented integration with ChatGPT, which opens the door to any “Virtual Expert” type application. Industries from Insurance to Finance to Travel to Government Services and everything in between, can and will take advantage of AI Agents to make their products more accessible to the public.

How often have you heard the phrases: “If I could only talk to someone who understands all this!” – well, now the technology exists to truly make that happen.

To learn more about creating an AI Agent with SitePal and integrating with ChatGPT (or any 3rd party AI solution) see our recent blog entry – www.sitepal.com/blog?p=239.

So, with all that in mind we’ve just added several new healthcare professionals to our lineup. To review our full lineup of characters see: www.sitepal.com/collection, or create your own character from a photo using Photoface. If you need a custom character for your application – let us know.

We’re constantly working on new SitePal features & capabilities (and great new characters too!). Stay tuned for more updates…

Warm Regards,

The SitePal Team

www.sitepal.com

What does your site say?”

ps. Why type your questions when you could speak them? Voice based interaction would be so much better! An idea whose time has come? We think so. Check out our latest AI Speech demo here – www.aispeechdemo.com

Hello SitePal Fans!

We are delighted to let you know that SitePal is now pre-integrated with ChatGPT.

What does this mean, and how can you take advantage of it?

SitePal has long supported building intelligent agents using its built-in AIML based capability. This means that you can create a knowledge base (a ‘Bot’) which contains relevant information for your visitors, and use a SitePal character as an intelligent agent to communicate with your website visitors. Your website visitors can learn about your products and services by conversing with your SitePal character.

We’ve now enhanced this capability with connectivity to 3rd party bots. The first such integration was with Pandorabots several weeks ago, now followed by OpenAI’s ChatGPT.

The following technical example allows you to select which Bot to interact with. Select ChatGPT from the menu & try it out by asking questions.

            sitepal.com/examples/sayAI-3rdpartyBot.html

So what do you need to do to create a useful ChatGPT implementation for your website?

In broad strokes the effort would consist of 2 parts:

1. Open an account with OpenAI and teach your ChatGPT bot about your products (or anything else you want it to know)

2. Setup a SitePal character on your website to answer users questions by interacting with your ChatGPT bot.

The first part can be implemented using tools provided by OpenAI and other companies. This is outside the scope of our explanation here.

The second part is where our Pre-Integration comes into play. To publish your SitePal character as a speaking ChatGPT driven inteligent agent, you need to add your OpenAI API key to your SitePal account. Then use our sayAI API call (yes, ONE call !) to have your character speak the responses to user questions.

We did the heavy lifting – so you don’t need to!  It’s that easy.

Please see detailed step-by-step instruction in the following technical note – and start taking advantage of intelligent agent technology today!

           sitepal.com/docs/Implementing_Your_AI_Agent.pdf

Additional 3rd party AI vendors will be integrated with SitePal in the coming months. If you have a specific one in mind, drop us a note and let us know. We will do our best to prioritize.

Warm Regards,

The SitePal Team

www.sitepal.com

“What does your site say?”

ps. Why type your questions when you can speak them? Talking to your bot would be so much better!  An idea whose time has come? We think so. Check out our new AI Speech Demo here – www.aispeechdemo.com

We’ve received many inquiries about using SitePal with React Native, and we’ve worked hard to make that possible.

React Native makes building mobile apps much simpler as many developers are coming to realize. This is mainly because it allows web developers to capitalize on their existing expertise, but also because it is a cross platform tool that enables you to build native apps for both iOS and Android.

For a nice rundown of React Native advantages see: www.geeksforgeeks.org/why-you-should-choose-react-native

Now you can embed your SitePal character, and control it from your native app using the SitePal API, which is fully supported.

Before we proceed, we’d like to point out that this feature is limited to Platinum Plan subscribers.

To support your SitePal integration with React Native we’ve made available the following resources:

  • Developer documentation
  • SitePal NPM Package for React Native developers
  • A full source code example
  • Video tutorials for both iOS and Android

These resources are available on our support page here: www.sitepal.com/support   

We’re very excited about the possibilities this opens up for mobile app integration& hope you will be too!

We’re actively working on additional features & capabilities (and new characters!) to be added soon… Stay tuned for more information.

Warm regards,

The SitePal Team

www.sitepal.com

What does your site say?”

ps. If you are just starting out with SitePal, or it’s been a while since you used SitePal (so much has changed…) we encourage you to check out our video tutorials, available on our support page here – www.sitepal.com/support

Customers sometimes ask us whether SitePal characters’ lip animation can be improved.

Well, if you are using human recorded audio then the answer is yes! We recently launched a very useful update we’d like to make you aware of.

Note:

  • This improvement applies only to 3D characters & works only for English for now
  • For TTS – the improvement is automatically applied – see explanation below

When you upload (or record) an audio, you will now see a “transcript” section where you can add… yes, a text transcript of the audio.

The text transcript is used to improve our automated lip-sync analysis and produce better results.

How much better?

We put together two SitePal Scenes for you to compare. “Before” and “After” if you will. Unlike the Pepsi challenge – you’ll need to keep your eyes open! Take a look:

Uploaded without transcript: www.sitepal.com/geturl/?ss=2756599&sl=0&acc=7029566

Uploaded with transcript: www.sitepal.com/geturl/?ss=2756598&sl=0&acc=7029566

As you can see the improvement is noticeable. So when adding audios to your account do take the time to add a text transcript to each audio, it is well worth the effort. To apply this improvement to existing (recorded or uploaded) audios, you would need to re-upload your audios and enter a text transcript for each.

The other (unrelated) advantage of adding a text transcript to your audio is that it enables subtitle display. If subtitles are relevant to your implementation – we suggest reading the technical note “Adding Subtitles to your Scene”, on our support page.

Note:

  • for TTS (both static and dynamic) adding a transcript is usually unnecessary because the text used to generate the audio is automatically applied to enhance the Lip-Sync as well. So there’s nothing you need to do. But in some cases you may still benefit from adding transcript to your TTS text input. That might be the case if your TTS text is heavily phonetic, or contains SSML tags. A good way to think about it is: TTS text is meant to be machine readable. The transcript is meant to be human readable (whether used for Lip-Sync or subtitles or both). To the extent the TTS text is modified to enhance the former, you might benefit from the latter.

Oh, before we forget – do check out our new AI Demo – if you haven’t done so already! See – www.aispeechdemo.com

We’re actively working on additional features & capabilities (and new characters!) to be added soon… Stay tuned for more information.

Warm regards,

The SitePal Team

www.sitepal.com

What does your site say?”

To demonstrate the potential of SitePal characters for chat bot visualization, we’ve created a cool new demo, now available at:

https://www.aispeechdemo.com

( tip: click on the “die” button to select other SitePal characters )

The point of this demo is to showcase 2-way speech interface, coupled with SitePal integration. The specific AI bot integrated here is not the point – as SitePal can be used as the animated face for any AI chat bot.

To implement the speech recognition part we’re using the Web Speech API. The Web Speech API is an evolving web standard which is now built-in to most browsers* and can be used for speech recognition.

A technical example is also available on our support pages – where you can more easily peruse the source code and see how it is put together. See at:

https://sitepal.com/api/examples/sayAI-STT.html

As always – our examples are meant to be copied and used – so check out the source code of the page and feel free to use it with your SitePal account.

To learn more about implementing SitePal for your AI bot, send us a note to support@sitepal.com & ask for guidelines.

*Note: the Web Speech API is universally supported on all platforms and browsers – including mobile -with the exception of the Firefox browser. The demo (and example) automatically reverts to text input when Firefox is used.

Oh, and last but not least – we’ve just added new animal characters, now available to all SitePal customers. Check out our entire collection here – https://sitepal.com/collection

As always, we’re actively working on additional features & capabilities (and new characters!) to be added soon… Stay tuned for more information.

Warm regards,

The SitePal Team

www.sitepal.com

What does your site say?”

We have long offered built-in AI knowledge base creation (known as SitePal AIMC) – and we are proud to have recognized the value and practical potential of AI so early on (more than 15 years ago…)

At the same time we also recognize there are many AI solutions out there, using different technologies, and designed for different audiences and use cases. There IS ONE THING they all share though: they can all benefit from an animated speaking avatar as their (user-inter) Face. After all – why communicate via text when you can do so by speaking? An idea whose time has come? We think so.

So we’ve gone ahead and done two things:

1. We’ve implemented 3rd party AI integration

2. We’ve demonstrated how to connect with the Web Speech API to enable speech input.

Let’s go over these one by one and explain exactly what we mean.

Part I – 3rd Party AI Integration

Our customers have been integrating SitePal characters with their 3rd party AI for years, so what’s changed? What’s new now is that we’ve gone ahead and made it much simpler to do.

Instead of implementing API connectivity from your web page to two services – SitePal & your AI provider – the AI programming interface is now taken care of by us. All you need to do is setup your 3rd Party API key in your SitePal account, and from that moment on, your SitePal character is connected! To implement you still need to use the SitePal API – but that’s all you need.

The first 3rd party AI solution to be integrated is Pandorabots – long a favorite of ours. We put together a technical example to demonstrate how it’s done. Check it out here, and feel free to view and use the source code of the page – that’s what it’s for!

https://sitepal.com/api/examples/sayAI-3rdpartyBot.html

Pandorabots integration is available now to Gold plan users. Next on our list is Google Dialogflow, with other popular AI solutions to be added thereafter. Send us a note if you need a particular AI solution – we’ll add it to our to-do list.

Part II – Speaking to Your Speaking Character

The Web Speech API is an evolving web standard which is now built-in to most browsers* and can be used for speech recognition!

We’ve worked out how to add speech input to SitePal using the Web Speech API – and put together a working example – check it out:

https://sitepal.com/api/examples/sayAI-STT.html

As always – out examples are meant to be copied and used – so check out the source code of the page and feel free to use it.

*Note: the Web Speech API is now universally supported on all platforms and browsers – including mobile -with the exception of the Firefox browser. The example automatically reverts to text input when Firefox is used.

We’re actively working on additional new features & capabilities (and new characters!) to be added soon… Stay tuned for more information.

Warm regards,

The SitePal Team

Hello SitePal Fans!

As 2022 is coming to a close, we’re so excited to look back and consider all that we’ve accomplished this year – and the many new SitePal users we’ve welcomed on board.

Welcome all!

With so many product updates added in the past 12 months, we thought we’d give you a quick run down – just in case you missed some of them (and also because we’re so proud of what we’ve done…! ).

So here goes – just the highlites:

Photoface Automated Image Masking

When creating a 3D character from your photo, you no longer need to spend time painstakingly outlining the outline of the persona. This task has been automated, so you can try out different images quickly!

Support for React, Angular and Vue Frameworks

Using NPM packages it is now a snap to integrate SitePal in your web project.

Audio Playback Limits – Removed

No more 90 seconds limit! Assign multiple audios to your Scene to be spoken in sequence. Or – if you are using the TTS API, you can now feed in text as long as you like. The 900 character limit has been removed.

New Tutorial Videos

Our new “Getting Started” tutorials are short (8 and 12 minutes respectively) but are jam packed with useful info and tips – and get you on board in no time.

No-Javascript” Embed

You can now publish your SitePal to those pesky blogs or CMS or LMS systems that do not permit Javascript code. Yes – for real!

Subtitles Now Supported

Add text subtitles to your speaking character, in any language. The character & the displayed text conform responsively to the available space!

Speech Recognition Integration Example

Speak to your SitePal character – and it responds. How cool is that?

With full source code available – you can build your own!

3rd Party Integration – Pandorabots

Integration with Pandoarabots intelligent agents is now built-in. Just add your PB api key to your SitePal account – and your speaking character will be connected to your Pandorabots smarts. Now that’s intelligent! (with more integrations to come)

New User Interface

The new user interface improves usability and clarifies all aspects of SitePal use – as so many customers have told us!

And…. we’ve not even mentioned the huge cast of new characters we’ve added this year. Do check them out.

As always – we’re actively working on new features & capabilities to be added soon… Stay tuned for more information.

Happy Hollidays!

The SitePal Team

www.sitepal.com

What does your site say?”

ps. If you are looking to get started with SitePal, or it’s been a while since you used SitePal (so much has changed…) we encourage you to check out our new video tutorials, available on our support page here – www.sitepal.com/support