SAFE Network Dev Update - November 1, 2018

Summary

Here are some of the main things to highlight this week:

  • The second version of the Crust Test is now online! See this post for more information on how to join it.
  • @jean-philippe is the newest member of the Routing team.
  • @Vinitha_05 joins the team today as Assistant Manager in the Chennai office.
  • The front-end team would like to encourage community members to participate in the discussions around how to store RDF data on the SAFE Network. The discussion is taking place in this Dev Forum topic.

Marketing

This week in Marketing, weā€™ve been preparing for the release of the v2 Crust Test - from videos, to voiceovers, forum instructions, screenshots and social messaging and the inevitable GDPR discussions. Weā€™re also about to start using the new CoinGecko Beam service to share Development Updates. Itā€™s an interesting service as the information will then be delivered via API to other crypto apps and widgets and itā€™s an approach that weā€™d like to build on each week in order to expand the distribution of our updates way beyond the reach of this Forum. In amongst the other stats and content weā€™ve been juggling this week, weā€™ve also been working on a new email subscriber plan - but more of this to follow very shortly!

Recruitment

Yet again we would like to welcome new members to the team :tada: (check us out taking on new hires two weeks in a row :smile: )

@jean-philippe joined the company today as the newest member of our Routing team and he will be based here at HQ. JP has been following MaidSafe for a number of years and took the opportunity to approach us directly when he found out we were recruiting.

@Vinitha_05 also joins the team today as Assistant Manager in the Chennai office and will be working very closely with Krishna and Nadia.

Please give them both a warm forum welcome.

Marketing Strategist - after @dugcampbell, @victoria and @nicklambert conducted final interviews last week, the role has been offered and accepted. We will have more information for you next week on their start date.

Executive Assistant - @Victoria has conducted first stage interviews for this role and is looking to move to the second and final stage by the end of this week/start of next week.

Network Engineer - yup still looking :slight_smile:

Software Test Engineer - @StephenC, @Chriso and @victoria have conducted 2 interviews this week and we hope to be in a position to update you on this role next week.

User Experience

Ok, so weā€™re all hyped about the latest Crust test I know, but having done our tidying, tweaking and preparing, this week has been beautifully quiet. Not a put-your-feet-up kind of quiet, but a deep thinking, creating, sleeves rolled up kind of determined quiet.

Thinking isnā€™t the same as doing, we know, but there is reason for you to pay attention here and perhaps allow yourself just a little excitement. I know I am. For what we turn our attention to now is the ecosystem.

On the one hand, the SAFE Network is infrastructure: the autonomous mega server ready to be built upon in all manner of ways. On the other hand, itā€™s something akin to an OSā€”to be inhabitedā€”accessed from a multitude of platforms and countless contexts. This is the ecosystem.

How do we design this ecosystem on a trajectory that takes us through to launch and beyond? And how do we make useful, understandable, trusted tools that are relevant and helpful now, and yet grow to maturity for public release?

This is the stuff of a quiet week. My kind of silence.

SAFE API & Apps

For those keeping an eye on our safe_browser repository and project board, you probably know already we are working on fixing high priority bugs, but we have been especially looking at a bug related to an apparent corruption of the mock file in a certain scenario. Weā€™ve been working closely with the SAFE Client Libs team on this issue and even though we have more ideas of how to reproduce it and some theories of what could be happening, we are still trying to find its exact root cause. We found a workaround which can be used by developers that are hitting this bug too often. We have added the details as a comment to the issue itself on GitHub (thanks a lot @nigel for helping us with validating this workaround).

Weā€™ve been able to resume our research on RDF related topics, and for those who didnā€™t have the chance to read and/or participate in the discussions around how to store RDF data on the SAFE Network, we would like to invite and encourage you to do so. The discussion is taking place in this Dev Forum topic, where we are trying to explain the reasoning behind the decisions made for the PoC implementation (that we presented at the Decentralized Web Summit 2018) and the type of things we consider important.

There is also an ongoing effort to have an RFC ready for the proposal of migrating our DNS system data into an RDF representation format. We are aiming at triggering the discussion and public review of it hopefully in the next few days. This is an important aspect of the research being made by the frontend team since it will allow us to standardise not only the DNS system data, but also the format we use for our Files Containers/Maps (like the data stored by our NFS emulation layer).

The initial implementation of the getting started Android application to demonstrate the use of the safe_app_java API is complete and a pull request has been raised which is being tested and reviewed.

SAFE Client Libs

We have been working together with the front-end team to analyse the bugs that they discovered and reported. In parallel, we have kick-started the process of preparing the next SAFE Client Libs release which should combine a lot of changes and bug fixes that have gone into SAFE Client Libs since the latest release in July. The progress of the new release has been slowed down a bit as part of the team switched to help with the Crust Test and we didnā€™t have enough resources for code reviews and testing. However, with more requirements from the front-end team, weā€™ll be giving more attention to Client Libs in the coming days.

Routing

The thorough work on systematic detection of various forms of malice continues in Routing.

This week, we finished implementing and testing the detection of an invalid gossip creator (if a node relays gossip from a node they shouldnā€™t have accepted gossip from). We also implemented detection of a gossip event thatā€™s invalid because itā€™s other_parent has been created by its own creator (node faking communication to itself).

We progressed the implementation that detects an accomplice and wrote tests for it. An accomplice is a node which misses an opportunity to accuse a malicious node.

So far, we have been performing functional testing of each malice detection we have implemented. This consists of thinking of one or two scenarios for each kind of malice and verifying that the code behaves as expected in these cases. Starting this week, we will be complementing these tests with randomized tests as part of our integration test suites. This will allow various edge cases to be tested, especially when combining different types of malice; allowing us to cover many more situations than we could possibly come up with on our own. In the process of writing these tests, we already identified a few subtle issues that we are addressing in the same scope. For instance, we caught and fixed an interesting behaviour where nodes would accuse themselves of malice due to a bug. We also identified an issue in our recently introduced fork handling code. We are still addressing this issue. This development is extremely valuable as it allows us to catch our errors earlier, which means that fixing them costs less resources. Also, it allows us to build up a growing amount of confidence in our code as we are building it; which is a great place to be for any software project.

We wrote some tests for the API functions that were added recently to facilitate integration with the Routing library. We also started soak testing a specific commit for early integration with Routing while the malice handling work continues. This will allow us to progress the work on sharding in Routing in parallel with the continuing work in making PARSEC production ready.

After the structural changes to PARSEC of the last few weeks, we have been continuing to bring the graphs writing and parsing up-to-date. This is useful for tests and for manual analysis of the codeā€™s behaviour.

On the community front, @pierrechevalier83 and @jonhaggblad attended Mozfest over the weekend with @povilasb. It was quite inspirational to see so many open source projects communicating about their ideals. In particular, the trend of protecting individual userā€™s data is becoming more and more important and many projects are tackling that beast from many angles. We particularly enjoyed our stop at the Solid booth where Ruben Verborgh laid out the vision for separation of data and applications within Solid in an inspirational speech. We also enjoyed Tim Berner Leeā€™s keynote talk on the same subject.

@pierrechevalier83 also attended the latest SAFE Network meetup in London on Tuesday. The attendance was low but the quality of discussions was there and it was a pleasure to participate. We discussed ways to build up the attendance in future meetings. Watch this space! :wink:

Last but not least, the Routing team is happy to welcome our latest addition today: Jean-Philippe is bringing with him 11 years of experience in software development, including 5 years developing networking applications. He has been interested in Rust since the early 1.0 days and has been interested in MaidSafe since 2014. Per tradition, he will tell you more about himself in his own words in the next few days.

Crust

This week was all about the second Crust test and the required preparation work: implementing, testing, and polishing the direct connections. We started with testing it internally and analysing the logs we got as a result, discovering a surprising network behaviour in some cases. One of such cases was shared and explained in the Forum topic ā€œCrust Test: Why Encryption Mattersā€.

We have been also working together with the QA team to automate the builds and deployments as much as possible. Both @ChrisO and @StephenC provided their invaluable help and expertise in that and now we have got rid of the repetitive tasks.

74 Likes

First (20charā€¦)

Yay, my first time first!

16 Likes

Great update and welcome to the new peops! Theyā€™re coming on fast now!

Iā€™m looking forward to giving the rust test v2 a spin!

17 Likes

22 Likes

Welcome folks! Almost looks like @maidsafe is adding more people than Elon Musk even though heā€™s going to Mars! :grin:.

Great update, so much stuff going on.

24 Likes

Great update! Excited to test Crust again tonight! I appreciate the shout out but id like to direct the credit to @Nick_Virag whom is kicking some tail with a full on rebuild of JAMS, and @hunterlester for the assistance with the workaround! Keep up the great work @maidsafe

26 Likes

Indeed! Great work and I really like the quality of these updates. This isnā€™t a quick update thingy and I appreciate the time it takes to write these updates and be transparent to the community. Good job and looking forward to the next one!
it was amazing to see the previous test running on my screen and looking forward to testing this build.

17 Likes

iā€™m impressed with the hiring-spree! so many new faces in such a short time - iā€™m losing count.
Could we have a section on the new website with names and pictures?

13 Likes

Something like this? About Us | MaidSafe :wink:

20 Likes

CRUST is working, weā€™re connecting through the mist, invisible data tendrils touching. Like 70% and higher connections on average. Great work! Thanks for the opportunity to be part of history!

16 Likes

Another great overview of the weekā€™s progressā€¦ amazing work!

Iā€™m checking in from Malta, attending the Malta Blockchain summit (8,000 attendeesā€¦ itā€™s mad), which is greatā€¦ but itā€™s missing something.

In the blockchain world there are problems with scaling, that are showstoppers if not solved, problems with infrastructure that makes it hard / impossible to deliver high quality dapps, problems with lack of interoperability between systems etc etc.

Whatā€™s needed is a decentralised platform that enables applications to be built in a way that avoids all of these pitfalls, while being totally decentralisedā€¦ and the blockchain world is largely unaware that the solution is being built by MaidSafe, and will take the scene by storm in due course.

Keep up the amazing work, and keep bring this much needed tech closer to reality :slight_smile:

17 Likes

Thanks for the whole Maidsafe team for the all the work you have done. Nice to see team growing!

7 Likes

Only 34? I thought around 40 minimum now

1 Like

Congrats and welcome @Vinitha_05 and @Jean-Philippe!

And really great to see the team being built out so quickly!

9 Likes

We are adding folk faster than pictures right now :slight_smile:

26 Likes

Great update and a lot of exciting developments!!

Thatā€™s a fantastic opportunity to amplify the SAFE message!

Beautifully poetic. Love it :smile:

8 Likes

Nice work team. Yet another one with an optimistic tone behind the writing :slight_smile:

4 Likes

I was thinking if any week that Dev Update has/had missed in the past.

关ę³Øļ¼ŒåøŒęœ›ēœ‹åˆ°maidsafeé•æč¶³čæ›ę­„怂

ē›®å‰å­˜äŗ†å°‘量ēš„coin,åøŒęœ›čƒ½ęœ‰ę±‰åŒ–ē‰ˆęœ¬ć€‚