WEBVTT

00:01.400 --> 00:09.480
Hi, I'm going to present A Scaffold-Based Tool 
for Product Design Variations in Virtual Reality.

00:09.480 --> 00:15.360
This work is done by Xue Yu, 
Stephen DiVerdi and Yotam Gingold.

00:15.360 --> 00:22.960
This project is a collaboration of George 
Mason University and Adobe Research.

00:22.960 --> 00:29.360
If you search for product design sketch, you 
will find a lot of images look like this.

00:29.360 --> 00:36.000
if we zoom in on one of them, we 
will see the draw sketches like this.

00:36.000 --> 00:39.545
Product designers often drawing use 
a technique called analytic drawing,

00:39.545 --> 00:46.105
and they draw scaffold to help them 
draw shape curves more accurately.

00:46.444 --> 00:50.644
This is a wide taught 
techniques in design schools,  

00:50.644 --> 00:56.269
the product designers will 
draw the scaffold first,

00:56.269 --> 00:57.949
and then draw the shape curve

01:02.771 --> 01:11.731
they will also often use freehand 
drawing to add more details

01:11.731 --> 01:17.097
The set of scaffold, shape and detail 
strokes are heavily interrelated.

01:17.097 --> 01:26.297
As a result, once the draft is completed, 
modifications are extremely difficult.

01:26.297 --> 01:33.297
However product designers 
love to explore variations,

01:33.461 --> 01:38.181
and the product design by 
nature is a iterative process

01:38.181 --> 01:46.661
but they have to start over to create 
a variation once the sketch is complete

01:46.770 --> 01:51.050
There are a lot of related work 
on analytic drawing and design variations

01:51.124 --> 01:57.938
but not not much link them before

01:57.938 --> 02:06.618
We propose to use scaffolds to assist designers 
in exploring and modifying their product designs,

02:06.618 --> 02:11.218
our key Insight is that the same 
scaffolds designers created for  

02:11.218 --> 02:18.138
analytic drawing provide 
an intuitive set of handles

02:18.138 --> 02:27.778
The user can interleave drawing details 
strokes and scaffold manipulation.

02:31.294 --> 02:40.614
Shape curves and detail strokes 
both move along with the scaffolds.

02:40.614 --> 02:45.368
ScafoldSketch allow designers 
to use analytic drawing VR,  

02:45.368 --> 02:51.808
it founds the scaffolds relationships are 
often perpendicular parallel and equal-length.

02:51.916 --> 02:57.856
And the shape curves are guided by the scaffolds, 
this provide a foundation for our project.  

02:57.856 --> 03:06.056
However,  ScafoldSketch is to build constraints, 
and our project is to use scaffolds as handles.

03:06.446 --> 03:14.046
There are three technical challenges to 
use scaffolds as handles for deformation.

03:14.046 --> 03:17.406
The first one is which constraints to remove ?

03:17.491 --> 03:24.131
For this cube shared end point, same-length, 
perpendicular and parallel constraints between  

03:24.131 --> 03:31.051
the scaffold lines will prevent 
the user from doing any edit.

03:31.051 --> 03:34.731
Release different constraints 
will give us different results.  

03:34.731 --> 03:40.651
We also support multiple scaffolds select and edit

03:40.651 --> 03:43.651
as the video shows, the user can obtain any  

03:43.651 --> 03:48.891
of these results by select 
different set of scaffolds.

03:50.880 --> 03:55.480
To solve it, we first identify 
all constraints between scaffolds. 

03:55.480 --> 04:02.880
When the user did an edit, there will be 
broken constraints and newly introduced ones.

04:02.880 --> 04:06.120
We remove the broken ones and add the new ones,  

04:06.120 --> 04:11.240
there could be conflicting 
constraints in this set.

04:11.240 --> 04:16.560
And we use Iterative Weighted 
Least Squares to resolve conflicts,  

04:16.560 --> 04:25.920
obtain the new set of constraints, and 
use it to update the scaffold's positions.

04:25.920 --> 04:29.440
Another challenge is how 
to update the shape curves? 

04:29.440 --> 04:38.400
If not updated properly, shape curves 
will appear distorted or unnatural.

04:38.400 --> 04:46.720
We express shape curves piecewise cubic Bézier and 
represent them in the scaffold coordinate system.

04:46.720 --> 04:51.000
We select a minimal set of 
nearby scaffolds as the basis. 

04:51.000 --> 04:59.320
This ensures that when updating, the Bézier 
control points and directions updated properly.

04:59.320 --> 05:04.200
We also support detail strokes 
and used similar ideas.

05:04.200 --> 05:10.440
We express them as weighted 
averages of scaffold endpoints.

05:10.440 --> 05:15.760
The weights are carefully chosen to 
be sparse and favor nearby scaffolds,  

05:15.760 --> 05:24.120
so the detail strokes can be updated properly. 
Please see the paper for more details.

05:24.120 --> 05:28.040
We did an expert study to evaluation our tool.

05:28.040 --> 05:35.880
Our evaluation goal was to assess how well 
our tool integrates into designers’ workflows,  

05:35.880 --> 05:43.760
whether it provides the right functionality, 
and if it produces high-quality output.

05:43.760 --> 05:49.360
However, finding product designers 
locally was a major challenge.

05:49.360 --> 05:53.800
Product design is a highly specialized field,  

05:53.800 --> 05:59.240
and the pool of product designers is 
much smaller than the general population.

05:59.240 --> 06:01.560
In our recruitment efforts,  

06:01.560 --> 06:06.520
we couldn’t find professionals 
within several hours of our location.

06:06.520 --> 06:10.880
And because of the client- 
server structure of our tool,  

06:10.880 --> 06:16.520
setting up a remote environment 
is also very challenging.

06:16.520 --> 06:21.480
So instead of user study—where 
we’d train participants to use  

06:21.480 --> 06:24.840
the tool—we conducted a utility study.

06:24.840 --> 06:30.320
We interviewed product designers worldwide 
through video walkthroughs. In the end,

06:31.040 --> 06:40.480
we also successfully found one designer with VR 
headset who completed a hands-on remote study.

06:40.480 --> 06:49.360
We gathered their feedback and conducted a 
thematic analysis to extract the key insights.

06:49.360 --> 06:53.720
Feedback from these experts 
validated the usefulness of our  

06:53.720 --> 06:59.520
tool and suggested directions for future research.

07:01.960 --> 07:05.760
Here are some results, the first is input,  

07:05.760 --> 07:17.360
and and all the others are the 
variations based on the first one.

07:17.360 --> 07:20.320
Limitation and Future work, we still want to  

07:20.320 --> 07:27.600
get more hands-on feedback from 
product designers in the future.

07:27.600 --> 07:34.640
And also how a 3D scaffolded sketch can be edited 
depends on how it was drawn in the first place 

07:34.640 --> 07:39.960
different drawings lead to different 
topologies and editing handles.

07:39.960 --> 07:44.000
For example, in the figure 
the bottle is very similar,  

07:44.000 --> 07:46.560
however constructed a little bit differently.

07:46.560 --> 07:52.280
The additional scaffold underneath 
the lid in (a) versus (b) allows the  

07:52.280 --> 07:57.520
designer to control the shape of the 
neck when performing an identical edit  

07:57.520 --> 08:03.800
to the scaffold lines forming 
the top of the lid (c) and (d).

08:03.800 --> 08:09.400
This can be seen as either 
a feature or a limitation

08:09.400 --> 08:14.560
In the future, we would also want to 
integrate with some existing methods.

08:14.560 --> 08:21.240
For example we want to integrate ScaffoldSketch 
so users can draw and edit at the same time

08:21.240 --> 08:27.160
Or even using some techniques 
to generate automatic scaffolds  

08:27.160 --> 08:31.360
when loading the model so the user can edit them

08:31.360 --> 08:36.360
In conclusion, We showed that the 
scaffolds created by designers during  

08:36.360 --> 08:43.840
the analytic drawing process can serve as 
handles for exploring design variations.

08:43.840 --> 08:48.080
Our work addresses the gap in the 
literature by allowing industrial  

08:48.080 --> 08:54.520
designers to easily deform shapes made 
with scaffold-based sketching in 3D,

08:54.520 --> 08:59.440
helping them combine their sketching and 
digital deformation skills in a natural way.  

09:00.000 --> 09:07.800
And validated the benefits, adoptability, 
and future potential through expert study.

09:07.800 --> 09:11.520
Thank you