Design options enabled by Nvidia AI (mirrors, HUD, etc.)

Tom Bodera

Active Member
Joined
Aug 10, 2016
Messages
162
Location
Hillsburgh, ON, CA
Tesla Owner
No
Country
Country
#1
To piggy back off of Trev's latest video about Autopilot 2.0 and possible Model 3 Hud predictions.


While I agree with the possibilities of what Trevor said, I would love nothing more than what was described, I have found some information that makes more sense.

Tesla has always been trying to remove the side view mirrors to reduce the drag coefficient. (see how they are trying to get to 0.21 but had made the model 3 the same height as an S but shorter and hence more resistant). I do not see hwo they will achieve the 0.21 without removing the side view mirrors as they wanted with the Alpha version of the Model X.

My reasoning is that the Nvidia drive CX which works with the Drive PX2 to handle 3 screens. Trevor's interpretation was the ability to use this as a HUD or Augmented reality.

The simpler option is to use a simple hud for basic displays and 2 screens for side view mirrors.

"
NVIDIA DRIVE™ CX is a complete hardware and software solution that enables advanced graphics and computer vision for navigation, infotainment, digital instrument clusters, and driver monitoring. It also enables surround vision, which solves the problem of blind spots with an undistorted, top-down, 360-degree view of the car in real time, and can completely replace a physical mirror with a digital smart mirror. -

http://www.nvidia.ca/object/drive-cx-request.html

Just my two sense. Hope Trev is right however. That would be the coolest.

Tom
 

TrevP

TOO Founder / Administrator
Founder
Joined
Mar 1, 2016
Messages
6,561
Location
Toronto
Tesla Owner
Model X
Country
Country
#4
I was going to mention that side cameras could replace mirrors given they can drive 3 monitors but I didn't want to give anyone hopes for that because it requires regulatory approval whereas a HUD doesn't.

On a side note I wrote a blog post to go along with the video which will be posted at evannex.com and also sent the video to Teslarati.com. Both will pick up the news today or tomorrow so we can expect a flood of attention on it.

Cheers
 
Last edited:

Tom Bodera

Active Member
Joined
Aug 10, 2016
Messages
162
Location
Hillsburgh, ON, CA
Tesla Owner
No
Country
Country
#5
One could do Augmented reality overlays on the side mirror screens.

As Trevor mentioned the issue is legislative approval. Unless there is things happening in the background that we are unaware of, I do not think that can happen yet either. Especially considering no one has mentioned it in any US state or Canada for a while.
 

Gilberto Pe-Curto

Well-Known Member
Joined
Oct 20, 2016
Messages
324
Location
Almada, Portugal
Tesla Owner
Reservation
Country
Country
#6
If you want to replace side mirrors with 2 screens, all you really need to do is connect those two screens directly to cameras. You don't need any of that expensive computing power.
It totally makes sense to remove the RearView mirrors.
Though , I think it would take sometime to like a car without that for most of people...
and Tesla's mirrors are really nice...they are almost aesthetical elements on the car.
I'll get used to that....
;-)
 

Michael Russo

MSM Team Founder, Midnight S≡R≡NITY rider
Moderator
TOO Supporting Member
Joined
Oct 15, 2016
Messages
5,799
Location
Pau, France
Tesla Owner
Model S
Country
Country
#7
It totally makes sense to remove the RearView mirrors.
Though , I think it would take sometime to like a car without that for most of people...
and Tesla's mirrors are really nice...they are almost aesthetical elements on the car.
I'll get used to that....
;-)
I'll take AR HUD... with or without mirrors!! :)
 

MelindaV

☰ > 3
Moderator
Joined
Apr 2, 2016
Messages
9,068
Location
Vancouver, WA
Tesla Owner
Model 3
Country
Country
#8
The only problem is that two cameras are on the bottom of the side view mirrors.
I don't think there are cameras on the mirrors. The new AP hardware includes cameras in the side markers, and other cars with the 360 camera systems have cameras pointing down at the pavement on the mirrors, but I've not seen anything showing Tesla is doing those (yet?)
 
Joined
Nov 6, 2016
Messages
66
Location
Atlanta
#9
Yes, you are correct. I do not know why I thought I saw the camera placement there, on a video.

On another note, removing the sideview mirrors would decrease the overall side-rear visual/safety effectiveness. During manual driving, human visual acuity, via the side mirror, is much higher/better than the camera.
 

Dan Detweiler

Top-Contributor
Joined
Apr 8, 2016
Messages
1,573
Location
Canton, Georgia
Country
Country
#10
Yes, you are correct. I do not know why I thought I saw the camera placement there, on a video.

On another note, removing the sideview mirrors would decrease the overall side-rear visual/safety effectiveness. During manual driving, human visual acuity, via the side mirror, is much higher/better than the camera.
I am interested to know how the limited view through a potentially misaligned/dirty mirror is somehow more safe than the wide view and object recognition of Teslavision displayed onto a screen/projection directly in front of the driver. No head turn or dramatic change of focus.

Not trying to start a fight by any means. Just interested in the justification.

Dan
 
Joined
Nov 6, 2016
Messages
66
Location
Atlanta
#12
I am interested to know how the limited view through a potentially misaligned/dirty mirror is somehow more safe than the wide view and object recognition of Teslavision displayed onto a screen/projection directly in front of the driver. No head turn or dramatic change of focus.

Not trying to start a fight by any means. Just interested in the justification.

Dan
That would be a bit like wondering how the view through a potentially dirty camera lens would be safer than looking through an equally dirty side mirror. Unless completely degraded visibility was involved, higher resolution (human eye coupled with a mirror) would be safer. Also, I would think government safety regulators might have an issue, if their is no back up. Wouldn't they want officers to be able to issue tickets the same as if a side mirror was missing/damaged? How would the officers know, if you weren't driving the car with all external safety functions working?

The best solution is to have both (camera view and side view mirrors).
 

Dan Detweiler

Top-Contributor
Joined
Apr 8, 2016
Messages
1,573
Location
Canton, Georgia
Country
Country
#13
That would be a bit like wondering how the view through a potentially dirty camera lens would be safer than looking through an equally dirty side mirror. Unless completely degraded visibility was involved, higher resolution (human eye coupled with a mirror) would be safer. Also, I would think government safety regulators might have an issue, if their is no back up. Wouldn't they want officers to be able to issue tickets the same as if a side mirror was missing/damaged? How would the officers know, if you weren't driving the car with all external safety functions working?

The best solution is to have both (camera view and side view mirrors).
I would assume that it would be the driver's responsibility to have all of the cameras working properly. Field of view would be MUCH greater with a camera system. Absolutely no blind spots whatsoever. As to higher resolution of the human eye...I guess you haven't see my vision screenings lately. ;)

Just on a side note and I have no clue what the statistics might be, I wonder how many injuries are caused each year by the mirrors sticking out from the car? I know I have a big scar on my chin from when I was a kid due to a rear view mirror.

As with all things, time will tell what ends up on the car.

Dan
 

Gilberto Pe-Curto

Well-Known Member
Joined
Oct 20, 2016
Messages
324
Location
Almada, Portugal
Tesla Owner
Reservation
Country
Country
#14
That would be a bit like wondering how the view through a potentially dirty camera lens would be safer than looking through an equally dirty side mirror. Unless completely degraded visibility was involved, higher resolution (human eye coupled with a mirror) would be safer. Also, I would think government safety regulators might have an issue, if their is no back up. Wouldn't they want officers to be able to issue tickets the same as if a side mirror was missing/damaged? How would the officers know, if you weren't driving the car with all external safety functions working?

The best solution is to have both (camera view and side view mirrors).
I can't stop me from agreeing with this.
I love the mirrors and I see the camera advantages, but any mechanical (not electrical) device is always more reliable than electrical/electronical... almost always...

And the amount of dirt needed to block the camera is much, much lesser than to block a mirror from being working.

I'm not saying with this that I wouldn't like rearview cameras...
I'm just pointing out some aspects that most of techy people don't think about when support electronic devices
 

Michael Russo

MSM Team Founder, Midnight S≡R≡NITY rider
Moderator
TOO Supporting Member
Joined
Oct 15, 2016
Messages
5,799
Location
Pau, France
Tesla Owner
Model S
Country
Country
#15
I am interested to know how the limited view through a potentially misaligned/dirty mirror is somehow more safe than the wide view and object recognition of Teslavision displayed onto a screen/projection directly in front of the driver. No head turn or dramatic change of focus.

Not trying to start a fight by any means. Just interested in the justification.

Dan
I am with you, Dan, with one caveat... we would also have to keep the (8!) cameras of the T≡SLAVision clean... certainly the ones in the back... and particularly in places where it rains a lot...!! I have to do that frequently with the rearview camera on my Beemer yet it takes a minute (often resulting in the need to wash my finger... :p) and the result is clear (no pun intended :))
 
Last edited:

Michael Russo

MSM Team Founder, Midnight S≡R≡NITY rider
Moderator
TOO Supporting Member
Joined
Oct 15, 2016
Messages
5,799
Location
Pau, France
Tesla Owner
Model S
Country
Country
#16
I am with you, Dan, with one caveat... we would also have to keep the (8!) cameras of the T≡SLAVision clean... certainly the ones in the back... and particularly in places where it rains a lot...!! I have to do that frequently with the rearview camera on my Beemer yet it takes a minute (often resulting in the need to wash my finger... :p) and the result is clear (no pun intended :))
Sorry, @Dan Detweiler , had not read #13 when I wrote the above... yet we see eye to eye :p) the driver is on point... and in any case she/he will want to keep cameras in optimal conditions to 'drive' the spaceship around safely !!
 

MelindaV

☰ > 3
Moderator
Joined
Apr 2, 2016
Messages
9,068
Location
Vancouver, WA
Tesla Owner
Model 3
Country
Country
#17
I'll add, my current Franz V.H. designed car would benefit GREATLY if it had cameras instead of side mirrors. With the top up, and especially if there is a second person in the car, the visibility of what may be to the right/left and slightly back is nonexistent. Changing lanes on the freeway is an utter leap of faith (so remember that if you are sitting in the blind spot of a Solstice or Sky with it's top up ;) )
Here's a couple shots of the views using the rear view, right side mirror and looking to the right from the safety of my garage.

IMG_7440.jpg

IMG_7441.jpg

IMG_7443.JPG

I didn't bother with the view to the left, because when you turn your head to the left, you are looking directly at the fabric roof and have no view beyond the driver side window. You can see (or not) what essentially is the B pillar is over a foot wide and the rear window is just above eye level.
If this car had camera's instead of just side mirrors and very limited direct visibility, I would be much more comfortable.

I fully understand the configuration of my car is not typical of most passenger vehicles as far are windows/visibility, but wanted to give an example of how cameras could be a vast improvement over mirrors.
 

Michael Russo

MSM Team Founder, Midnight S≡R≡NITY rider
Moderator
TOO Supporting Member
Joined
Oct 15, 2016
Messages
5,799
Location
Pau, France
Tesla Owner
Model S
Country
Country
#18
I'll add, my current Franz V.H. designed car would benefit GREATLY if it had cameras instead of side mirrors. With the top up, and especially if there is a second person in the car, the visibility of what may be to the right/left and slightly back is nonexistent. Changing lanes on the freeway is an utter leap of faith (so remember that if you are sitting in the blind spot of a Solstice or Sky with it's top up ;) )
Here's a couple shots of the views using the rear view, right side mirror and looking to the right from the safety of my garage.

View attachment 742

View attachment 740

View attachment 741

I didn't bother with the view to the left, because when you turn your head to the left, you are looking directly at the fabric roof and have no view beyond the driver side window. You can see (or not) what essentially is the B pillar is over a foot wide and the rear window is just above eye level.
If this car had camera's instead of just side mirrors and very limited direct visibility, I would be much more comfortable.

I fully understand the configuration of my car is not typical of most passenger vehicles as far are windows/visibility, but wanted to give an example of how cameras could be a vast improvement over mirrors.
And how you'll be thrilled to trade it with your brand spanking new Model ≡ with 360deg. vision!! :) Coming soonest to Oregon!! :)
 

Badback

Valued Community Member
TOO Supporting Member
Joined
Apr 7, 2016
Messages
1,111
Location
Prior Lake, MN
Tesla Owner
Reservation
Country
Country
#19
Having cameras instead of mirrors would be safer for me. Assuming that the normal blind spots would be covered by the cameras. Arthritis in my neck, among other places, makes it difficult and painful for me to turn my head to check the blind spots. Hey, someday you too will be old, if your lucky.