Supplementary Website

Supplementary website

View the Project on GitHub nicolehoess/emse2025.github.io

Collaboration and coordination

Supplementary material for the replication of Joblin et al., 2017.

Metrics agreement

Django

All ranges Django

Range 0-3 Django

Range 4-7 Django

Range 8-11 Django

Range 12-15 Django

Range 16-19 Django

Range 20-23 Django

Range 24-27 Django

Range 28-31 Django

Range 32-35 Django

Range 36-39 Django

Range 40-43 Django

FFmpeg

All ranges FFmpeg

Range 1-4 FFmpeg

Range 5-8 FFmpeg

Range 9-12 FFmpeg

Range 13-16 FFmpeg

Range 17-20 FFmpeg

Range 21-24 FFmpeg

Range 25-28 FFmpeg

Range 29-32 FFmpeg

Range 33-36 FFmpeg

Range 37-40 FFmpeg

Range 41-44 FFmpeg

Range 45-48 FFmpeg

Range 49-52 FFmpeg

Range 53-56 FFmpeg

Range 57-60 FFmpeg

GCC

All ranges GCC

Range 0-3 GCC

Range 4-7 GCC

Range 8-11 GCC

Range 12-15 GCC

Range 16-19 GCC

Range 20-23 GCC

Range 24-27 GCC

Range 28-31 GCC

Range 32-35 GCC

Range 36-39 GCC

Range 40-43 GCC

Range 44-47 GCC

Range 48-51 GCC

Range 52-55 GCC

Range 56-59 GCC

Range 60-63 GCC

Range 64-67 GCC

Range 68-71 GCC

Range 72-75 GCC

Range 76-79 GCC

Range 80-83 GCC

Range 84-87 GCC

Range 88-91 GCC

Range 92-95 GCC

Range 96-99 GCC

Range 100-103 GCC

Range 104-107 GCC

LLVM

All ranges LLVM

Range 0-3 LLVM

Range 4-7 LLVM

Range 8-11 LLVM

Range 12-15 LLVM

Range 16-19 LLVM

Range 20-23 LLVM

Range 24-27 LLVM

Range 28-31 LLVM

Range 32-35 LLVM

Range 36-39 LLVM

Range 40-43 LLVM

Range 44-47 LLVM

Range 48-51 LLVM

Range 52-55 LLVM

Range 56-59 LLVM

PostgreSQL

All ranges PostgreSQL

Range 0-3 PostgreSQL

Range 4-7 PostgreSQL

Range 8-11 PostgreSQL

Range 12-15 PostgreSQL

Range 16-19 PostgreSQL

Range 20-23 PostgreSQL

Range 24-27 PostgreSQL

Range 28-31 PostgreSQL

Range 32-35 PostgreSQL

Range 36-39 PostgreSQL

Range 40-43 PostgreSQL

Range 44-47 PostgreSQL

Range 48-51 PostgreSQL

Range 52-55 PostgreSQL

Range 56-59 PostgreSQL

Range 60-63 PostgreSQL

Range 64-67 PostgreSQL

Range 68-71 PostgreSQL

Range 72-75 PostgreSQL

Range 76-79 PostgreSQL

QEMU

All ranges QEMU

Range 1-4 QEMU

Range 5-8 QEMU

Range 9-12 QEMU

Range 13-16 QEMU

Range 17-20 QEMU

Range 21-24 QEMU

Range 25-28 QEMU

Range 29-32 QEMU

Range 33-36 QEMU

Range 37-40 QEMU

Range 41-44 QEMU

Range 45-48 QEMU

Range 49-52 QEMU

U-Boot

Range 0-3 U-Boot

Range 4-7 U-Boot

Range 8-11 U-Boot

Range 12-15 U-Boot

Range 16-19 U-Boot

Range 20-23 U-Boot

Range 24-27 U-Boot

Range 28-31 U-Boot

Range 32-35 U-Boot

Range 36-39 U-Boot

Range 40-43 U-Boot

Range 44-47 U-Boot

Range 48-51 U-Boot

Range 52-55 U-Boot

Range 56-59 U-Boot

Range 60-63 U-Boot

Wine

All ranges Wine

Range 0-3 Wine

Range 4-7 Wine

Range 8-11 Wine

Range 12-15 Wine

Range 16-19 Wine

Range 20-23 Wine

Range 24-27 Wine

Range 28-31 Wine

Range 32-35 Wine

Range 36-39 Wine

Range 40-43 Wine

Range 44-47 Wine

Range 48-51 Wine

Range 52-55 Wine

Range 56-59 Wine

Range 60-63 Wine

Range 64-67 Wine

Range 68-71 Wine

Range 72-75 Wine

Range 76-79 Wine

Range 80-83 Wine

Range 84-87 Wine

Range 88-91 Wine

Hierarchy stability

Django

Range 0-3 Django

Range 4-7 Django

Range 8-11 Django

Range 12-15 Django

Range 16-19 Django

Range 20-23 Django

Range 24-27 Django

Range 28-31 Django

Range 32-35 Django

Range 36-39 Django

Range 40-43 Django

FFmpeg

Range 1-4 FFmpeg

Range 5-8 FFmpeg

Range 9-12 FFmpeg

Range 13-16 FFmpeg

Range 17-20 FFmpeg

Range 21-24 FFmpeg

Range 25-28 FFmpeg

Range 29-32 FFmpeg

Range 33-36 FFmpeg

Range 37-40 FFmpeg

Range 41-44 FFmpeg

Range 45-48 FFmpeg

Range 49-52 FFmpeg

Range 53-56 FFmpeg

Range 57-60 FFmpeg

GCC

Range 8-11 GCC

Range 12-15 GCC

Range 16-19 GCC

Range 20-23 GCC

Range 24-27 GCC

Range 28-31 GCC

Range 32-35 GCC

Range 36-39 GCC

Range 40-43 GCC

Range 44-47 GCC

Range 48-51 GCC

Range 52-55 GCC

Range 56-59 GCC

Range 60-63 GCC

Range 64-67 GCC

Range 68-71 GCC

Range 72-75 GCC

Range 76-79 GCC

Range 80-83 GCC

Range 84-87 GCC

Range 88-91 GCC

Range 92-95 GCC

Range 96-99 GCC

Range 100-103 GCC

Range 104-107 GCC

LLVM

Range 0-3 LLVM

Range 4-7 LLVM

Range 8-11 LLVM

Range 12-15 LLVM

Range 16-19 LLVM

Range 20-23 LLVM

Range 24-27 LLVM

Range 28-31 LLVM

Range 32-35 LLVM

Range 36-39 LLVM

Range 40-43 LLVM

Range 44-47 LLVM

Range 48-51 LLVM

Range 52-55 LLVM

Range 56-59 LLVM

PostgreSQL

Range 0-3 PostgreSQL

Range 4-7 PostgreSQL

Range 8-11 PostgreSQL

Range 12-15 PostgreSQL

Range 16-19 PostgreSQL

Range 20-23 PostgreSQL

Range 24-27 PostgreSQL

Range 28-31 PostgreSQL

Range 32-35 PostgreSQL

Range 36-39 PostgreSQL

Range 40-43 PostgreSQL

Range 44-47 PostgreSQL

Range 48-51 PostgreSQL

Range 52-55 PostgreSQL

Range 56-59 PostgreSQL

Range 60-63 PostgreSQL

Range 64-67 PostgreSQL

Range 68-71 PostgreSQL

Range 72-75 PostgreSQL

Range 76-79 PostgreSQL

QEMU

Range 17-20 QEMU

Range 21-24 QEMU

Range 25-28 QEMU

Range 29-32 QEMU

Range 33-36 QEMU

Range 37-40 QEMU

Range 41-44 QEMU

Range 45-48 QEMU

Range 49-52 QEMU

U-Boot

Range 12-15 U-Boot

Range 16-19 U-Boot

Range 20-23 U-Boot

Range 24-27 U-Boot

Range 28-31 U-Boot

Range 32-35 U-Boot

Range 36-39 U-Boot

Range 40-43 U-Boot

Range 44-47 U-Boot

Range 48-51 U-Boot

Range 52-55 U-Boot

Range 56-59 U-Boot

Range 60-63 U-Boot

Wine

Range 20-23 Wine

Range 24-27 Wine

Range 28-31 Wine

Range 32-35 Wine

Range 36-39 Wine

Range 40-43 Wine

Range 44-47 Wine

Range 48-51 Wine

Range 52-55 Wine

Range 56-59 Wine

Range 60-63 Wine

Range 64-67 Wine

Range 68-71 Wine

Range 72-75 Wine

Range 76-79 Wine

Range 80-83 Wine

Range 84-87 Wine

Range 88-91 Wine

Tools agreement

Django

All ranges Django

Range 0-3 Django

Range 4-7 Django

Range 8-11 Django

Range 12-15 Django

Range 16-19 Django

Range 20-23 Django

Range 24-27 Django

Range 28-31 Django

Range 32-35 Django

Range 36-39 Django

Range 40-43 Django

FFmpeg

All ranges FFmpeg

Range 1-4 FFmpeg

Range 5-8 FFmpeg

Range 9-12 FFmpeg

Range 13-16 FFmpeg

Range 17-20 FFmpeg

Range 21-24 FFmpeg

Range 25-28 FFmpeg

Range 29-32 FFmpeg

Range 33-36 FFmpeg

Range 37-40 FFmpeg

Range 41-44 FFmpeg

Range 45-48 FFmpeg

Range 49-52 FFmpeg

Range 53-56 FFmpeg

Range 57-60 FFmpeg

GCC

All ranges GCC

Range 0-3 GCC

Range 4-7 GCC

Range 8-11 GCC

Range 12-15 GCC

Range 16-19 GCC

Range 20-23 GCC

Range 24-27 GCC

Range 28-31 GCC

Range 32-35 GCC

Range 36-39 GCC

Range 40-43 GCC

Range 44-47 GCC

Range 48-51 GCC

Range 52-55 GCC

Range 56-59 GCC

Range 60-63 GCC

Range 64-67 GCC

Range 68-71 GCC

Range 72-75 GCC

Range 76-79 GCC

Range 80-83 GCC

Range 84-87 GCC

Range 88-91 GCC

Range 92-95 GCC

Range 96-99 GCC

Range 100-103 GCC

Range 104-107 GCC

LLVM

All ranges LLVM

Range 0-3 LLVM

Range 4-7 LLVM

Range 8-11 LLVM

Range 12-15 LLVM

Range 16-19 LLVM

Range 20-23 LLVM

Range 24-27 LLVM

Range 28-31 LLVM

Range 32-35 LLVM

Range 36-39 LLVM

Range 40-43 LLVM

Range 44-47 LLVM

Range 48-51 LLVM

Range 52-55 LLVM

Range 56-59 LLVM

PostgreSQL

All ranges PostgreSQL

Range 0-3 PostgreSQL

Range 4-7 PostgreSQL

Range 8-11 PostgreSQL

Range 12-15 PostgreSQL

Range 16-19 PostgreSQL

Range 20-23 PostgreSQL

Range 24-27 PostgreSQL

Range 28-31 PostgreSQL

Range 32-35 PostgreSQL

Range 36-39 PostgreSQL

Range 40-43 PostgreSQL

Range 44-47 PostgreSQL

Range 48-51 PostgreSQL

Range 52-55 PostgreSQL

Range 56-59 PostgreSQL

Range 60-63 PostgreSQL

Range 64-67 PostgreSQL

Range 68-71 PostgreSQL

Range 72-75 PostgreSQL

Range 76-79 PostgreSQL

QEMU

All ranges QEMU

Range 1-4 QEMU

Range 5-8 QEMU

Range 9-12 QEMU

Range 13-16 QEMU

Range 17-20 QEMU

Range 21-24 QEMU

Range 25-28 QEMU

Range 29-32 QEMU

Range 33-36 QEMU

Range 37-40 QEMU

Range 41-44 QEMU

Range 45-48 QEMU

Range 49-52 QEMU

U-Boot

Range 0-3 U-Boot

Range 4-7 U-Boot

Range 8-11 U-Boot

Range 12-15 U-Boot

Range 16-19 U-Boot

Range 20-23 U-Boot

Range 24-27 U-Boot

Range 28-31 U-Boot

Range 32-35 U-Boot

Range 36-39 U-Boot

Range 40-43 U-Boot

Range 44-47 U-Boot

Range 48-51 U-Boot

Range 52-55 U-Boot

Range 56-59 U-Boot

Range 60-63 U-Boot

Wine

All ranges Wine

Range 0-3 Wine

Range 4-7 Wine

Range 8-11 Wine

Range 12-15 Wine

Range 16-19 Wine

Range 20-23 Wine

Range 24-27 Wine

Range 28-31 Wine

Range 32-35 Wine

Range 36-39 Wine

Range 40-43 Wine

Range 44-47 Wine

Range 48-51 Wine

Range 52-55 Wine

Range 56-59 Wine

Range 60-63 Wine

Range 64-67 Wine

Range 68-71 Wine

Range 72-75 Wine

Range 76-79 Wine

Range 80-83 Wine

Range 84-87 Wine

Range 88-91 Wine