HACKING 13.3 KB
Newer Older
1 2 3 4 5 6 7
The guidelines in this file are the ideals; it's better to send a
not-fully-following-guidelines patch than no patch at all, though.  We
can always polish it up.

Mailing list
===

8
The D-Bus mailing list is dbus@lists.freedesktop.org; discussion
9 10 11 12 13
of patches, etc. should go there.

Security
===

14 15 16 17 18
If you find a security vulnerability that is not known to the public,
please report it privately to dbus-security@lists.freedesktop.org
or by reporting a freedesktop.org bug that is marked as
restricted to the "D-BUS security group".

John Palmieri's avatar
John Palmieri committed
19
Most of D-Bus is security sensitive.  Guidelines related to that:
20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66

 - avoid memcpy(), sprintf(), strlen(), snprintf, strlcat(),
   strstr(), strtok(), or any of this stuff. Use DBusString. 
   If DBusString doesn't have the feature you need, add it 
   to DBusString. 

   There are some exceptions, for example
   if your strings are just used to index a hash table 
   and you don't do any parsing/modification of them, perhaps
   DBusString is wasteful and wouldn't help much. But definitely 
   if you're doing any parsing, reallocation, etc. use DBusString.

 - do not include system headers outside of dbus-memory.c, 
   dbus-sysdeps.c, and other places where they are already 
   included. This gives us one place to audit all external 
   dependencies on features in libc, etc.

 - do not use libc features that are "complicated" 
   and may contain security holes. For example, you probably shouldn't
   try to use regcomp() to compile an untrusted regular expression.
   Regular expressions are just too complicated, and there are many 
   different libc's out there.

 - we need to design the message bus daemon (and any similar features)
   to use limited privileges, run in a chroot jail, and so on.

http://vsftpd.beasts.org/ has other good security suggestions.

Coding Style
===

 - The C library uses GNU coding conventions, with GLib-like
   extensions (e.g. lining up function arguments). The
   Qt wrapper uses KDE coding conventions.

 - Write docs for all non-static functions and structs and so on. try
   "doxygen Doxyfile" prior to commit and be sure there are no
   warnings printed.

 - All external interfaces (network protocols, file formats, etc.)
   should have documented specifications sufficient to allow an
   alternative implementation to be written. Our implementation should
   be strict about specification compliance (should not for example
   heuristically parse a file and accept not-well-formed
   data). Avoiding heuristics is also important for security reasons;
   if it looks funny, ignore it (or exit, or disconnect).

67 68 69 70
Development
===

D-Bus uses Git as its version control system. The main repository is
71 72
hosted on freedesktop.org. To clone D-Bus, execute one of the
following commands:
73

74 75 76
    git clone https://anongit.freedesktop.org/git/dbus/dbus.git
    git clone git://anongit.freedesktop.org/dbus/dbus
    git clone ssh://git.freedesktop.org/git/dbus/dbus
77

78 79
The last form is the one that allows pushing, but it also requires
an SSH account on the server. The other forms allow anonymous
80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149
checkouts.

D-Bus development happens in two branches in parallel: the current
stable branch, with an even minor number (like 1.0, 1.2 and 1.4), and
the next development branch, with the next odd number.

The stable branch is named after the version number itself (dbus-1.2,
dbus-1.4), whereas the development branch is simply known as "master".

When making a change to D-Bus, do the following:

 - check out the earliest branch of D-Bus that makes sense to have
   your change in. If it's a bugfix, it's normally the current stable
   branch; if it's a feature, it's normally the "master" branch. If
   you have an important security fix, you may want to apply to older
   branches too.

 - for large changes:
     if you're developing a new, large feature, it's recommended
     to create a new branch and do your development there. Publish
     your branch at a suitable place and ask others to help you
     develop and test it. Once your feature is considered finalised,
     you may merge it into the "master" branch.

- for small changes:
    . make your change to the source code
    . execute tests to guarantee that you're not introducing a
      regression. For that, execute: make check
      (if possible, add a new test to check the fix you're
      introducing)
    . commit your change using "git commit"
      in the commit message, write a short sentence describing what
      you did in the first line. Then write a longer description in
      the next paragraph(s).
    . repeat the previous steps if necessary to have multiple commits

 - extract your patches and send to the D-Bus mailing list for
   review or post them to the D-Bus Bugzilla, attaching them to a bug
   report. To extract the patches, execute:
     git format-patch origin/master

 - once your code has been reviewed, you may push it to the Git
   server:
     git push origin my-branch:remote
   OR
     git push origin dbus-X.Y
   OR
     git push origin master
   (consult the Git manual to know which command applies)

 - (Optional) if you've not worked on "master", merge your changes to
   that branch. If you've worked on an earlier branch than the current
   stable, merge your changes upwards towards the stable branch, then
   from there into "master".

    . execute: git checkout master
    . ensure that you have the latest "master" from the server, update
      if you don't
    . execute: git merge dbus-X.Y
    . if you have any conflicts, resolve them, git add the conflicted
      files and then git commit
    . push the "master" branch to the server as well

  Executing this merge is recommended, but not necessary for all
  changes. You should do this step if your bugfix is critical for the
  development in "master", or if you suspect that conflicts will arise
  (you're usually the best person to resolve conflicts introduced by
  your own code), or if it has been too long since the last merge.


150 151 152
Making a release
===

John Palmieri's avatar
John Palmieri committed
153
To make a release of D-Bus, do the following:
154

155
 - check out a fresh copy from Git
156 157 158 159

 - verify that the libtool versioning/library soname is 
   changed if it needs to be, or not changed if not

Simon McVittie's avatar
Simon McVittie committed
160
 - update the file NEWS based on the git history
161

162 163 164 165
 - verify that the version number of dbus-specification.xml is
   changed if it needs to be; if changes have been made, update the
   release date in that file

Simon McVittie's avatar
Simon McVittie committed
166
 - update the AUTHORS file with "make update-authors" if necessary
167

Simon McVittie's avatar
Simon McVittie committed
168 169 170
 - the version number should have major.minor.micro, even
   if micro is 0, i.e. "1.0.0" and "1.2.0" not "1.0"/"1.2"; the micro
   version should be even for releases, and odd for intermediate snapshots
171

172 173 174 175
 - "make distcheck" (DO NOT just "make dist" - pass the check!)

 - if make distcheck fails, fix it.

176
 - once distcheck succeeds, "git commit -a".  This is the version
177
   of the tree that corresponds exactly to the released tarball.
178

179
 - tag the tree with "git tag -s -m 'Released X.Y.Z' dbus-X.Y.Z"
180
   where X.Y.Z is the version of the release.  If you can't sign
181 182
   then simply created an unsigned annotated tag:
   "git tag -a -m 'Released X.Y.Z' dbus-X.Y.Z".
183

184
 - bump the version number up in configure.ac (so the micro version is odd),
Simon McVittie's avatar
Simon McVittie committed
185
   and commit it.  Make sure you do this *after* tagging the previous
186
   release! The idea is that git has a newer version number
187 188
   than anything released. Similarly, bump the version number of
   dbus-specification.xml and set the release date to "(not finalized)".
189

190 191
 - merge the branch you've released to the chronologically-later
   branch (usually "master"). You'll probably have to fix a merge
192
   conflict in configure.ac (the version number).
193

194 195
 - push your changes and the tag to the central repository with
     git push origin master dbus-X.Y dbus-X.Y.Z
196

197 198 199
 - scp your tarball to freedesktop.org server and copy it to
   dbus.freedesktop.org:/srv/dbus.freedesktop.org/www/releases/dbus/dbus-X.Y.Z.tar.gz.
   This should be possible if you're in group "dbus"
200

201 202
 - Update the online documentation with `make -C doc maintainer-upload-docs`.

Joe Shaw's avatar
Joe Shaw committed
203
 - update the wiki page http://www.freedesktop.org/Software/dbus by
204 205 206 207
   adding the new release under the Download heading. Then, cut the
   link and changelog for the previous that was there.

 - update the wiki page
Joe Shaw's avatar
Joe Shaw committed
208
   http://www.freedesktop.org/Software/DbusReleaseArchive pasting the
209 210 211
   previous release. Note that bullet points for each of the changelog
   items must be indented three more spaces to conform to the
   formatting of the other releases there.
212
  
213
 - post to dbus@lists.freedesktop.org announcing the release.
214
 
215

216
Making a ".0" stable release
217 218
===

219 220 221
We create a branch for each stable release. The branch name should be
dbus-X.Y which is a branch that has releases versioned X.Y.Z;
changes on a stable branch should be limited to significant bug fixes.
222

223 224 225 226 227 228
Because we won't make minor changes like keeping up with the latest
deprecations on a stable branch, stable branches should turn off the
gcc warning for deprecated declarations (e.g. see commit 4ebb275ab7).

Be extra-careful not to merge master (or any branch based on master) into a
stable branch.
229

230
To branch:
Simon McVittie's avatar
Simon McVittie committed
231
  git branch dbus-X.Y
232
and upload the branch tag to the server:
Simon McVittie's avatar
Simon McVittie committed
233
  git push origin dbus-X.Y
234

235
To develop in this branch:
Simon McVittie's avatar
Simon McVittie committed
236
  git checkout dbus-X.Y
237

238 239 240
Environment variables
===

John Palmieri's avatar
John Palmieri committed
241
These are the environment variables that are used by the D-Bus client library
242 243

DBUS_VERBOSE=1
John Palmieri's avatar
John Palmieri committed
244
Turns on printing verbose messages. This only works if D-Bus has been
245 246 247 248
compiled with --enable-verbose-mode

DBUS_MALLOC_FAIL_NTH=n
Can be set to a number, causing every nth call to dbus_alloc or
John Palmieri's avatar
John Palmieri committed
249
dbus_realloc to fail. This only works if D-Bus has been compiled with
250 251 252 253 254
--enable-tests.

DBUS_MALLOC_FAIL_GREATER_THAN=n
Can be set to a number, causing every call to dbus_alloc or
dbus_realloc to fail if the number of bytes to be allocated is greater
John Palmieri's avatar
John Palmieri committed
255
than the specified number. This only works if D-Bus has been compiled with
256 257
--enable-tests.

258
DBUS_TEST_MALLOC_FAILURES=n
John Palmieri's avatar
John Palmieri committed
259
Many of the D-Bus tests will run over and over, once for each malloc
260 261 262 263 264 265 266 267 268
involved in the test. Each run will fail a different malloc, plus some
number of mallocs following that malloc (because a fair number of bugs
only happen if two or more mallocs fail in a row, e.g. error recovery
that itself involves malloc).  This env variable sets the number of
mallocs to fail.
Here's why you care: If set to 0, then the malloc checking is skipped,
which makes the test suite a heck of a lot faster. Just run with this
env variable unset before you commit.

269 270 271 272 273 274
Tests
===

These are the test programs that are built if dbus is compiled using
--enable-tests.

275
dbus/test-dbus
John Palmieri's avatar
John Palmieri committed
276
This is the main unit test program that tests all aspects of the D-Bus
277 278 279 280 281 282 283 284 285
client library.

dbus/bus-test
This it the unit test program for the message bus.

test/break-loader
A test that tries to break the message loader by passing it randomly
created invalid messages.

286 287 288 289 290
test/name-test/*
This is a suite of programs which are run with a temporary session bus.
If your test involves multiple processes communicating, your best bet
is to add a test in here.

291 292
"make check" runs all the deterministic test programs (i.e. not break-loader).

293 294
"make lcov-check" is available if you configure with --enable-compiler-coverage
and gives a complete report on test suite coverage.
295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313

Patches
===

Please file them at http://bugzilla.freedesktop.org under component
dbus, and also post to the mailing list for discussion.  The commit
rules are:

 - for fixes that don't affect API or protocol, they can be committed
   if any one qualified reviewer other than patch author
   reviews and approves

 - for fixes that do affect API or protocol, two people
   in the reviewer group have to review and approve the commit, and 
   posting to the list is definitely mandatory

 - if there's a live unresolved controversy about a change,
   don't commit it while the argument is still raging.

314 315 316 317 318 319 320 321 322 323 324 325 326 327
 - at their discretion, members of the reviewer group may also commit
   branches/patches under these conditions:

   - the branch does not add or change API, ABI or wire-protocol

   - the branch solves a known problem and is covered by the regression tests

   - there are no objections from the rest of the review group within
     a week of the patches being attached to Bugzilla

   - the committer gets a positive review on Bugzilla from someone they
     consider qualified to review the change (e.g. a colleague with D-Bus
     experience; not necessarily a member of the reviewer group)

328 329 330
 - regardless of reviews, to commit a patch:
    - make check must pass
    - the test suite must be extended to cover the new code
331
      as much as reasonably feasible (see Tests above)
332 333 334 335 336 337 338
    - the patch has to follow the portability, security, and 
      style guidelines
    - the patch should as much as reasonable do one thing, 
      not many unrelated changes
   No reviewer should approve a patch without these attributes, and
   failure on these points is grounds for reverting the patch.

339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355
The reviewer group that can approve patches:

Havoc Pennington <hp@pobox.net>
Michael Meeks <michael.meeks@novell.com>
Alexander Larsson  <alexl@redhat.com>
Zack Rusin <zack@kde.org>
Joe Shaw <joe@assbarn.com>
Mikael Hallendal <micke@imendio.com>
Richard Hult <richard@imendio.com>
Owen Fraser-Green <owen@discobabe.net>
Olivier Andrieu <oliv__a@users.sourceforge.net>
Colin Walters <walters@verbum.org>
Thiago Macieira <thiago@kde.org>
John Palmieri <johnp@redhat.com>
Scott James Remnant <scott@netsplit.com>
Will Thompson <will.thompson@collabora.co.uk>
Simon McVittie <simon.mcvittie@collabora.co.uk>
356
David Zeuthen <davidz@redhat.com>