Building service-based systems with the Service Oriented Architecture (SOA) requires knowledge and experience from diverse domains, including user interaction, service-oriented computing, as well as service platforms and infrastructures. These domains are addressed by different research communities. Therefore, joint research activities between these communities are key to provide novel service technologies for the Future Internet. As each community uses its own language, this poses significant communication challenges. To foster a common understanding of researchers, this paper reports on the process, the results and the lessons learned in devising an agreed terminology within the context of the NEXOF initiative. This terminology is freely accessible on the Web.