Project

General

Profile

WebRTC » History » Version 31

Adrian Georgescu, 09/03/2015 10:02 PM

1 1 Saúl Ibarra Corretgé
h1. SylkServer WebRTC gateway application
2
3 31 Adrian Georgescu
Starting with version 3.0.0 SylkServer features WebRTC gateway capabilities. This application implements a WebSocket protocol which WebRTC endpoints can use in order to interact bidirectionally with the SIP world.
4 2 Saúl Ibarra Corretgé
5 24 Adrian Georgescu
h2. Deployment scenarios
6
7 25 Adrian Georgescu
 * Web page calling using a WebRTC enabled web browsers like Firefox and Google Chrome
8 26 Adrian Georgescu
 * Mobile iOS and Android application for multimedia calling
9 24 Adrian Georgescu
10 2 Saúl Ibarra Corretgé
h2. Architecture
11 1 Saúl Ibarra Corretgé
12 25 Adrian Georgescu
SylkServer WebRTC gateway application consists of several (internal and external) components, which together aim to provide the same communication experience as with "Blink":http://icanblink.com or any other feature-full SIP client.
13 21 Saúl Ibarra Corretgé
14 29 Saúl Ibarra Corretgé
<pre>
15
+--------+               +-------------+ +----------+     +-------------+
16
|        |               |             | |          |     |     SIP     |   
17
| WebRTC |  SylkRTC API  |             | |  Janus   +<--->+ audio/video |
18
| client +<------------->+  SylkServer | |          |     |    calls    |   
19
|        |               |   WebRTC    | +----------+     +-------------+
20
+--------+               |   gateway   | +----------+     +-------------+
21
                         |             | | Presence |     |   SIMPLE    |   
22
                         |             | | and chat +<--->+     IM      |   
23
                         |             | | gateway  |     |   Presence  |
24
                         +-------------+ +----------+     +-------------+
25
</pre>
26 1 Saúl Ibarra Corretgé
27
All interaction with the gateway from the Web's side is performed through a WebSocket connection using the "sylkRTC protocol" described in this document.
28
29 25 Adrian Georgescu
h5. Registration
30
31
This function is equivalent to SIP REGISTER method and allows an end-point to receive incoming calls.
32
33 1 Saúl Ibarra Corretgé
h5. Audio / video sessions
34 21 Saúl Ibarra Corretgé
35 28 Adrian Georgescu
This function is equivalent to SIP INVITE method and allows an end-point to establish audio and video sessions using RTP protocol. On the web client side DTLS/SRTP encryption is being used. On the SIP side, at the current moment plain RTP is being used, SDES/SRTP being on the roadmap.
36 25 Adrian Georgescu
37 1 Saúl Ibarra Corretgé
Audio and video sessions support is provided through an external component: "Janus.":https://github.com/meetecho/janus-gateway SylkServer communicates directly with Janus and offers a complete API together with the rest of the components described below.
38 21 Saúl Ibarra Corretgé
39
h5. Chat sessions
40 1 Saúl Ibarra Corretgé
41 25 Adrian Georgescu
This function is equivalent to SIP INVITE method and allows an end-point to establish chat sessions using MSRP protocol.
42 1 Saúl Ibarra Corretgé
43 21 Saúl Ibarra Corretgé
Chat sessions are implemented as an internal component which translates JSON messages over WebSocket with MSRP chat messages. The payload will remain unchanged, so CPIM is mandatory and will be used end to end. A library such as "cpim.js":https://github.com/eface2face/cpim.js can be used to parse chat messages in a JavaScript application.
44
45 25 Adrian Georgescu
h5. Contacts management
46 21 Saúl Ibarra Corretgé
47 25 Adrian Georgescu
This function corresponds to its equivalent XCAP protocol GET/PUT/DELETE methods. Contacts management is implemented as an internal component which fetches the user's XCAP documents and translates the contact list into JSON format, which is then sent over the WebSocket connection.
48 21 Saúl Ibarra Corretgé
49 25 Adrian Georgescu
h5. Presence
50 21 Saúl Ibarra Corretgé
51
Presence information is gathered by sending SIP SUBSCRIBE requests on behalf of the user. The presence information is combined with the contact information and provided via JSON events to the application.
52 2 Saúl Ibarra Corretgé
53
h2. WebSocket API
54 5 Saúl Ibarra Corretgé
55 1 Saúl Ibarra Corretgé
SylkServer offers the WebSocket API in order to interact with the WebRTC gateway in the @ws(s)://hostname:port/webrtcgateway/ws@ endpoint. Both WebSocket and Secure WebSocket are supported, depending on how SylkServer was configured, check the configuration section.
56 18 Saúl Ibarra Corretgé
57 5 Saúl Ibarra Corretgé
The API uses JSON messages and is modeled around 2 concepts: requests and events. We call this the sylkRTC protocol.
58
59 1 Saúl Ibarra Corretgé
A request represents an action which SylkServer should perform, and it's identified with a transaction ID which the user must provide. SylkServer will reply with either an 'ack' or an 'error' response, with the associated transaction ID. An example transaction is that of adding an account.
60 5 Saúl Ibarra Corretgé
61
Events are notifications sent by SylkServer to the client. They are the result of some change triggered by a user action, but they don't have a transaction ID associated with them. An example event would be the connection state changed event.
62 1 Saúl Ibarra Corretgé
63 7 Saúl Ibarra Corretgé
All messages are valid JSON and contain the "sylkrtc" key indicating the message type. A message without the "sylkrtc" key is an invalid message.
64
65 5 Saúl Ibarra Corretgé
h3. Establishing the connection
66 1 Saúl Ibarra Corretgé
67 25 Adrian Georgescu
In order for a Web application to connect to SylkServer to begin to use the API a WebSocket connection must be established, using the @sylkRTC-1@ subprotocol. Example:
68 6 Saúl Ibarra Corretgé
69
<pre>
70
var conn = new WebSocket('wss://example.com/webrtcgateway/ws', 'sylkRTC-1');
71
</pre>
72
73
After the connection is established, a 'ready' event will be sent to the client, indicating that the connection is ready to be used:
74
75
<pre>
76 18 Saúl Ibarra Corretgé
{"event": "ready", "sylkrtc": "event"}
77 6 Saúl Ibarra Corretgé
</pre>
78 1 Saúl Ibarra Corretgé
79 7 Saúl Ibarra Corretgé
Example:
80
81
<pre>
82
var conn = new WebSocket('wss://example.com/webrtcgateway/ws', 'sylkRTC-1');
83
conn.onmessage = function(event) {
84
    var message = JSON.parse(event.data);
85
    switch (message.sylkrtc) {
86
        case 'event':
87
            if (message.event === 'ready') {
88
                console.log('Ready to rock!');
89
            }
90
            break;
91 1 Saúl Ibarra Corretgé
        default:
92
            console.log('Received message type: ' + message.sylkrtc);
93 7 Saúl Ibarra Corretgé
            break;
94
    }
95
};
96
</pre>
97 5 Saúl Ibarra Corretgé
98 18 Saúl Ibarra Corretgé
h3. Account management
99 8 Saúl Ibarra Corretgé
100 25 Adrian Georgescu
Multiple accounts can be managed from a single WebSocket connection. 2 types of requests are used to manage accounts: "account-add" and "account-remove". Once an account has been added it can be registered via SIP using the "account-register" command, and unregistered using the "account-unregister" command. Registration is required for receiving incoming calls. It's not necessary to register an account in order to make outgoing calls.
101 1 Saúl Ibarra Corretgé
102 18 Saúl Ibarra Corretgé
h5. account-add
103 13 Saúl Ibarra Corretgé
104 8 Saúl Ibarra Corretgé
Configures an account on the current connection.
105
106 1 Saúl Ibarra Corretgé
<pre>
107 8 Saúl Ibarra Corretgé
{'account': 'saghul@sip2sip.info',
108
 'password': '884edfee38ed471b8a15006700139485',
109 18 Saúl Ibarra Corretgé
 'sylkrtc': 'account-add',
110 8 Saúl Ibarra Corretgé
 'transaction': '04013f0f-25bb-4082-a02f-44399df492ff'}
111 1 Saúl Ibarra Corretgé
</pre>
112 8 Saúl Ibarra Corretgé
113 9 Saúl Ibarra Corretgé
The password MUST be in "HA1 format":https://en.wikipedia.org/wiki/Digest_access_authentication#Overview
114 18 Saúl Ibarra Corretgé
115 1 Saúl Ibarra Corretgé
h5. account-remove
116 9 Saúl Ibarra Corretgé
117
Removes an account from the current connection.
118
119 8 Saúl Ibarra Corretgé
<pre>
120 1 Saúl Ibarra Corretgé
{'account': 'saghul@sip2sip.info',
121 18 Saúl Ibarra Corretgé
 'sylkrtc': 'account-remove',
122 9 Saúl Ibarra Corretgé
 'transaction': 'bd3ee25d-5f16-4f76-b34e-8ac3fe0a4ac0'}
123
</pre>
124 1 Saúl Ibarra Corretgé
125 13 Saúl Ibarra Corretgé
h5. register
126 1 Saúl Ibarra Corretgé
127 25 Adrian Georgescu
Triggers the account registration via SIP REGISTER method.
128 1 Saúl Ibarra Corretgé
129 9 Saúl Ibarra Corretgé
<pre>
130
{'account': 'saghul@sip2sip.info',
131 18 Saúl Ibarra Corretgé
 'sylkrtc': 'account-register',
132 9 Saúl Ibarra Corretgé
 'transaction': 'bcb87b0f-0cc7-42a9-897e-81f035910670'}
133
</pre>
134
135
The registration progress will be reported in form of events.
136
137
<pre>
138
{'account': 'saghul@sip2sip.info',
139
 'data': {'state': 'registering'},
140
 'event': 'registration_state',
141
 'sylkrtc': 'account_event'}
142
143
{'account': 'saghul@sip2sip.info',
144
 'data': {'state': 'registered'},
145
 'event': 'registration_state',
146
 'sylkrtc': 'account_event'}
147 1 Saúl Ibarra Corretgé
</pre>
148 9 Saúl Ibarra Corretgé
149
Example of failed registration:
150
151
<pre>
152 1 Saúl Ibarra Corretgé
{'account': 'saghul@sip2sip.info',
153 9 Saúl Ibarra Corretgé
 'data': {'reason': '904 Operation has no matching challenge ',
154
          'state': 'failed'},
155
 'event': 'registration_state',
156
 'sylkrtc': 'account_event'}
157 1 Saúl Ibarra Corretgé
</pre>
158 9 Saúl Ibarra Corretgé
159 18 Saúl Ibarra Corretgé
h5. account-unregister
160 13 Saúl Ibarra Corretgé
161 1 Saúl Ibarra Corretgé
Unregister the account, via SIP.
162 10 Saúl Ibarra Corretgé
163
<pre>
164
{'account': 'saghul@sip2sip.info',
165 18 Saúl Ibarra Corretgé
 'sylkrtc': 'account-unregister',
166 1 Saúl Ibarra Corretgé
 'transaction': '1c81eea0-b247-4ced-b3b3-3ced1eba810e'}
167 10 Saúl Ibarra Corretgé
</pre>
168 9 Saúl Ibarra Corretgé
169 18 Saúl Ibarra Corretgé
h3. Sessions
170 1 Saúl Ibarra Corretgé
171 18 Saúl Ibarra Corretgé
h5. Incoming sessions
172 1 Saúl Ibarra Corretgé
173 18 Saúl Ibarra Corretgé
Incoming sessions are received via an *incoming_session* event:
174 14 Saúl Ibarra Corretgé
175 1 Saúl Ibarra Corretgé
<pre>
176 14 Saúl Ibarra Corretgé
{'account': 'saghul@sip2sip.info',
177 20 Saúl Ibarra Corretgé
 'data': {'originator': '31208005163@ag-projects.com', 'sdp': '...'},
178 18 Saúl Ibarra Corretgé
 'event': 'incoming_session',
179 1 Saúl Ibarra Corretgé
 'session': '509b256aa6a14540a2a37553e6bd33e1',
180 14 Saúl Ibarra Corretgé
 'sylkrtc': 'account_event'}
181 1 Saúl Ibarra Corretgé
182 14 Saúl Ibarra Corretgé
</pre>
183 1 Saúl Ibarra Corretgé
184 18 Saúl Ibarra Corretgé
The "session-answer" request can be used in order to answer an incoming session:
185 1 Saúl Ibarra Corretgé
186
<pre>
187 15 Saúl Ibarra Corretgé
{'sdp': '...',
188
 'session': '38dffdf81acb44b2b11b61f4488c4ca9',
189 18 Saúl Ibarra Corretgé
 'sylkrtc': 'session-answer',
190 15 Saúl Ibarra Corretgé
 'transaction': '179a855f-75a0-45a4-b5ef-0be8eb8389d1'}
191 1 Saúl Ibarra Corretgé
</pre>
192 15 Saúl Ibarra Corretgé
193 18 Saúl Ibarra Corretgé
h5. Outgoing sessions
194 14 Saúl Ibarra Corretgé
195 18 Saúl Ibarra Corretgé
In order to create an outgoing session the "session-create" request is used, by passing the SDP returned by the web browser. There is no need to wait for all ICE candidates since trickle ICE is used.
196 1 Saúl Ibarra Corretgé
197 14 Saúl Ibarra Corretgé
<pre>
198
{'account': 'saghul@sip2sip.info',
199
 'sdp': '...',
200
 'session': '20c40185-1ef2-419e-b91a-70415778acb4',
201 18 Saúl Ibarra Corretgé
 'sylkrtc': 'session-create',
202 1 Saúl Ibarra Corretgé
 'transaction': '7afcb91a-8a64-4664-9448-8cb760492e1f',
203
 'uri': '3333@sip2sip.info'}
204 14 Saúl Ibarra Corretgé
</pre>
205
206 15 Saúl Ibarra Corretgé
h5. Trickle ICE
207
208 18 Saúl Ibarra Corretgé
As new candidates are discovered they must be sent to the server using 'session-trickle' requests:
209 14 Saúl Ibarra Corretgé
210
<pre>
211
{'candidates': [{'candidate': 'candidate:0 1 UDP 2130379007 192.168.99.44 59051 typ host',
212
                 'sdpMLineIndex': 0,
213
                 'sdpMid': ''}],
214 1 Saúl Ibarra Corretgé
 'session': '20c40185-1ef2-419e-b91a-70415778acb4',
215 18 Saúl Ibarra Corretgé
 'sylkrtc': 'session-trickle',
216 1 Saúl Ibarra Corretgé
 'transaction': 'ecf777d8-7d26-4f16-bace-18f6fae5d8f8'}
217
</pre>
218
219 19 Saúl Ibarra Corretgé
Use an empty list of candidates to indicate that no more candidates will be sent.
220
221 15 Saúl Ibarra Corretgé
This applies to both incoming and outgoing calls.
222
223
There is no need to wait for the acknowledgement for the "session-create" or "session-answer" request before sending "session-trickle" requests.
224 1 Saúl Ibarra Corretgé
225 19 Saúl Ibarra Corretgé
h5. Terminating sessions
226 15 Saúl Ibarra Corretgé
227 19 Saúl Ibarra Corretgé
A session can be terminated at any time by sending the "session-terminate" request:
228 1 Saúl Ibarra Corretgé
229 15 Saúl Ibarra Corretgé
<pre>
230
{'session': '38dffdf81acb44b2b11b61f4488c4ca9',
231 19 Saúl Ibarra Corretgé
 'sylkrtc': 'session-terminate',
232 15 Saúl Ibarra Corretgé
 'transaction': '4d169de8-fe55-41f8-9a5c-c5f66c0a23c7'}
233 1 Saúl Ibarra Corretgé
</pre>
234 15 Saúl Ibarra Corretgé
235
h5. Events
236
237 19 Saúl Ibarra Corretgé
Session state related events are reported via the "session_event" event:
238 16 Saúl Ibarra Corretgé
239
<pre>
240
'data': {'state': 'established'},
241
 'event': 'state',
242
 'session': '38dffdf81acb44b2b11b61f4488c4ca9',
243
 'sylkrtc': 'session_event'}
244
</pre>
245
246
<pre>
247
{'data': {'sdp': '...', 'state': 'accepted'},
248
 'event': 'state',
249
 'session': '20c40185-1ef2-419e-b91a-70415778acb4',
250
 'sylkrtc': 'session_event'}
251
</pre>
252
253 1 Saúl Ibarra Corretgé
<pre>
254
{'data': {'reason': '200 to BYE', 'state': 'terminated'},
255
 'event': 'state',
256
 'session': '20c40185-1ef2-419e-b91a-70415778acb4',
257 16 Saúl Ibarra Corretgé
 'sylkrtc': 'session_event'}
258
</pre>
259 1 Saúl Ibarra Corretgé
260 19 Saúl Ibarra Corretgé
Valid session states:
261 17 Saúl Ibarra Corretgé
262 19 Saúl Ibarra Corretgé
* incoming: initial state for incoming sessions, no state event is sent for this state.
263
* progress: on outgoing sessions, when in progress.
264
* accepted: both for incoming and outgoing, when the session has been accepted by the remote party. For incoming, an "sdp" attribute will be present in the "data" section, as shown in the example above. 
265
* established: the session has been established media-wise.
266
* terminated: session was terminated, the "reason" attribute indicates the termination reason.
267 4 Saúl Ibarra Corretgé
268 25 Adrian Georgescu
h2. Zero-configuration
269 4 Saúl Ibarra Corretgé
270 27 Adrian Georgescu
The server is designed to work without any special configuration, its defaults settings will provide a working environment immediately after starting the software. It is however desirable to replace the bundled test TLS certificate with a valid TLS certificate for a valid hostname found in public DNS and signed by an authority recognised by web applications.
271 2 Saúl Ibarra Corretgé
272 23 Saúl Ibarra Corretgé
h2. JavaScript client library
273 1 Saúl Ibarra Corretgé
274 30 Saúl Ibarra Corretgé
In order to interact with SylkServer's WebRTC gateway, "sylkrtc.js":https://github.com/AGProjects/sylkrtc.js JavaScript library is provided. This library implements the API described in this document in an easy to use manner. Check the README file in the project for the JavaScript API documentation.