Evalart User FAQ

Evalart allows you to customize the background color and text color of the main menu, add a logo from the gallery, and modify the position of the logo. In addition, users can also customize the background color and text color of the test and report headers. To access the account customization, you must:

1. Expand the list of options for the “user” menu located in the main menu and select the “account customization” option.
2. If you already have a record created, click on the pencil button to the right of the record you wish to modify. If you do not have a record, create one by clicking the “new” button in the upper right corner to create a new personalization profile.
3. Perform the desired customizations. Among the options available are uploading your company logo, changing the position of the logo, changing the background color of the main menu, and changing the background color on tests and reports.
4. Save. NOTE: Only one customization profile can be created for all users of the account.

In addition, users can also customize result reports, emails sent to candidates, create user groups, and select who can access the processes.

You can personalize the mail that is sent to the candidate by following the steps described below:

If the user is in the process configuration

1. Click on the “edit mail” button in the “candidates” section.
   Make the desired customizations to the mail. Here, you can load saved templates, modify the format, and/or insert dynamic text.
2. Save the changes with the “save” button.

Besides, you can open the preview of the mail and/or save it as a template to be used in other processes using the “save and preview” and “save template” buttons.

If the user is outside the process settings

1. Expand the list of options for “selection processes” and select the option “process list”.
2. Once in the list, access the configuration by clicking on the wrench button located to the right of the process whose mail you want to modify.
3. Click on the “edit mail” button located to the right in the “candidates” section.
4. Make the desired customizations to the mail. Here, the user can load saved templates, modify the format, and/or insert dynamic text.
5. Save the changes with the “save” button.

Besides, you can open the preview of the mail and/or save it as a template to be used in other processes using the “save and preview” and “save template” buttons.

Evalart allows its users to modify the name to be displayed in the emails they send to candidates, which, by default, is “Evalart”. Below, we explain the steps to follow to customize the name in the emails:

1. Expand the list of options for the “user” menu located in the main menu and select the option “account preferences”.
2. If you already have a record created, click on the pencil button to the right of the record to modify it. If you do not yet have a record and the page tells you that “no records found”, you must create one by clicking the “new” button in the upper right corner. Note: you can only create one record per account.
3. In the account preferences page, go to the “name for emails” field and enter the name you want to be displayed in the mail. Note: if you leave this field empty, the name will still be shown as “Evalart”.
4. Save your changes.

Additionally, if you want that when the applicant responds, the email reaches a generic company email, you must check the option (in user settings) to use generic email and fill in the generic email field in the account settings.

You can add your company logo using the “account customization” option. There you can change the logo that appears in the administrator module menu, in the tests and in the reports, as well as other settings such as background and font colors. To do this, follow the steps described below:

1. Expand the list of options for the “user” menu located in the main menu and select the “account customization” option.
   If you already have a record, click on the pencil button to the right of the record. If you do not already have a record, create one by clicking the “new” button in the upper right corner to create a new personalization profile.
2. Go to the “logo” field, upload your company logo from the gallery or local files, adjust the position in the “logo position” field and, if desired, change the background color of the logo in the “proof: background color” field (this option will change only the background color of the header).
3. Save your changes.

NOTE: To upload files from the Evalart gallery, they must be uploaded to the gallery before following the steps described below:

1. In the main menu, expand the list of options for “configuration” and select “manage gallery”.
2. Click on the “browse…” button to select an image from the local files.
3. Locate the image file you wish to upload and select it.
4. Click the “upload” button to finish uploading the image to the gallery.

Evalart offers its users two options of reports, one corresponds to a detailed report of the results of a test for a particular candidate and the other to a summary report with the results of all the tests of a person for a selection process; both are configurable. The user can configure and build their own reports from the “result report types” option and create a new report  or clone an existing one in order to modify it.

In the report configuration, the user will be able to add and remove sections, choose what information will be shown in the report, the format of the score, the type of font to be used, etc. To access this configuration, the user must:

1. Expand the list of options for “configuration” located in the main menu, select the option “tests” and then the option “result report types”.
2. In the “types of result report” section, the user will be able to choose one of the existing reports and modify it (for this it is necessary to clone it first, since the user does not have permissions to edit the reports belonging to the tests in the catalog) or create a new one by clicking on the “new” button.
3. Add a description, a type of report (psychometric, test, summary or any) and the language.
4. Save and access the process or test configuration (depending on whether the report is for the summary by process or for individual tests) to make the desired modifications.
   If the user wishes to apply their own report to a test in the catalog (which he cannot modify), they must indicate that the report replaces the report belonging to that test in the catalog. This allows the user to use their own reports on Evalart tests for which they do not have editing permissions.

To replace a report with another one, the user must:

1. Go to the “replace this report” field.
2. Expand the report list, locate the report you wish to replace and select it.
3. Save.

This way the platform will show the report you are editing instead of the report selected in this field. When viewing a report on the platform it is also possible to directly access the report configuration from the menu in the upper right corner of the report on the screen (by entering this way the platform will automatically determine if it is necessary to clone the report and/or use the replace report option).

You can create user groups from the “manage user groups” option. There, the user can create groups and add users to them. To access this option, the user must:

1. Expand the list of options for the “user” menu located in the main menu and select the option “manage user groups”.
2. Click on the “new” button located in the upper right corner to create a new user group.
3. Click on “users x user group”.
4. Click the “new” button to add a new user to the group.
5. Select the user ID and the group ID to which you want to add the user.
6. Repeat the process with all the users you want to add to the group.
7. Save.

User groups allow you to restrict the selection processes a user has access to, if desired.

Evalart allows its users to create roles, through which they can restrict the access of other users to entities. These entities can be tests, processes, result reports, etc. The restriction can be read-only, full access, or no access. For this, it is necessary to perform the series of steps described below:
1. Drop down the “user” menu, located on the top bar, and select the “manage user roles” option.
2. Click on the “new” button.
3. When the screen for creating a new role appears, add a description, select a language and save the changes.
4. After you save the new role, click the pencil icon and select the “access by user role” button.
5. Click on the “new” button and select the entity whose access you want to restrict and the access that users belonging to this role will have, which can be no access, read-only, or full access. Save the changes.
6. Go again to the “User” menu, this time clicking on the “manage users” option.
7. Once at the list of users, identify the user whose role you want to update and click the pencil icon.
8. In the “Access Restriction by Role” field, select the role you previously created and save the changes.

In selection processes of the “With Registration” type, candidates must enter their data before taking the test and by default the requested fields are name, surname and email. If you want to capture other type of data, it is possible to define this in the process configuration view and click on the “Customize Record” button and choose the fields to use. At least one identity field must be selected (either email or identification). If you want to change the names of the labels, for example, call the alternative id field as “ID Card”, that can be done in the configuration option “Customization of Candidate Registration” (labels can be defined for each language)

Sorry, this entry is only available in European Spanish and Brazilian Portuguese. For the sake of viewer convenience, the content is shown below in one of the available alternative languages. You may click one of the links to switch the site language to another available language.

En Evalart es posible compartir pruebas y resultados con otras cuentas. Esta funcionalidad es ideal para grupos empresariales que quieren compartir pruebas (o preguntas) entre empresas del grupo, permitiendo así reutilizar el materia que una unidad produce para ser utilizadas por las demás. Otro caso de uso es para empresas que trabajan con proveedores de personal y desean que sus proveedores evalúen a sus postulantes utilizando las pruebas de la empresa contratante y que esta pueda ver los resultados.

El proceso para esto es crear un vinculo de socio entre una cuenta y la otra. El vinculo de socio es unidireccional, es decir, la cuenta que tiene socios puede compartir con sus socios, pero sus socios solo pueden compartir con esta si esta se vuelve socia también.

Para que una cuenta agregue socios, un usuario administrador debe ir al menú “Usuario” => “Administrar Cuentas Asociadas” y hacer clic en el botón de “Generar Enlace”. El enlace que se genera debe ser enviado al administrador de la cuenta que se desea convertir en socio. El administrador que recibe el enlace debe acceder a este mientras se encuentra logueado en Evalart, lo que le permitirá aceptar la invitación a ser socio. Hecho esto, el usuario que envío el enlace podrá ver el registro del socio en la misma vista de “Administrar Cuentas Asociadas” y deberá marcarlo como habilitado. Una vez habilitado el socio, es posible compartir pruebas o resultados con este. Si se desea que ambas partes puedan compartir, se debe realizar el mismo proceso, pero en el sentido inverso.

Para compartir pruebas se debe ir al listado de pruebas y editar (con el lápiz) e ir a la parte de “Ver Socios” donde podrá compartir la prueba utilizando el botón de compartir. Las pruebas se pueden compartir con acceso de solo lectura o con acceso total, en cuyo caso el socio puede modificar la prueba (el cambio aplicaría a ambas partes). Es posible dejar de compartir en cualquier momento. El proceso para compartir preguntas es el mismo. Las pruebas y preguntas aparecerán como otras pruebas y preguntas del catálogo desde el punto de vista de quien las recibe.

Para compartir resultados, esto se realiza desde la vista del reporte de resultados de la prueba, en el menú opciones. Elegir la opción de Compartir Reporte y con el botón compartir, agregar a los socios con quienes se quiere compartir el resultado. El código de proceso externo permite colocar un código externo que permitirá a quien recibe los resultados el poder buscar las pruebas que corresponden a ese código de proceso. El receptor de las pruebas puede verlas desde el menú de “Resultados” => “Reportes Compartidos”

To change the password (password) of your user account, you must enter the User menu => User Configuration and, in the password field, enter the new password. Then click on save.

Note: In case you do not remember your password and cannot enter the platform, you can use the password recovery option that appears in the platform login view.

1. On the Evalart home page, click on the “Selection Processes” option, located on the top bar.
2. Click on the option “Processes list”.
3. When you enter the processes list, click on the wrench icon located to the right of the process you want to modify.
4. When you access the configuration menu, you will be able to create a new candidate or choose an existing candidate.
   After you have added the candidates, click on the “Send” button. Invitations will only be sent to the added candidates, not to those who have already been invited.

1. On the Evalart home page, click on the “Selection Processes” option, located on the top bar.
2. Click on the option “Processes list”.
3. When you enter the process list, click on the key icon located to the right of the process you want to modify.
4. Click on the “Choose Tests” option. By clicking on this option, a box with the test catalog will open.
5. Mark the test(s) you wish to add.
6. Click on the “Select” button.
7. After adding the test(s) to the process, click on the option “Invite candidates”. The invitations will be sent to all candidates, but only with the link to the newly added test(s).

Yes, it is possible. Here are the steps to follow to assign a manual score:

1. On the Evalart home page, click on the “Reports” option, located on the top bar.
2. Click on the option “View sent tests”.
3. When you enter the list of tests, click on the pencil icon located to the right of the test whose score you wish to modify.
4. Select the question you wish to modify in the “Details by question” section.
5. Click on the pencil icon to the right of the score you wish to change.
6. Replace the old score with the new one.
7. Click on the “Save” icon to save your changes.

If you want a candidate to repeat the same test because they reported a problem (such as running out of internet during the test), you can reset the test by following these steps:

1. On the Evalart home page, click on the “Reports” option, located on the top bar.
2. Click on the option “View sent tests”.
3. When you enter the list of tests, click on the lightning icon located to the right of the test you wish to reset. Clicking on the lightning icon will reset the test and the candidate will be able to retake the test using the same link as before.

Please note that once you reset a test, the previous test results will be lost, if you need to keep them, you can save them as PDF and keep a copy.

An “expired” test indicates that the candidate ran out of time before completing the test and did not click the finish button. This may be because they closed their browser without clicking on finish when the platform indicated that time was up or that they left the test.

To force the calculation of an “expired” test score, the administrator must:

1. On the Evalart home page, click on the “Reports” option, located on the top bar.
2. Click on the “View sent tests” option.
3. Click on the check icon located to the right of the “expired” test.
4. Clicking on the check icon will force the calculation of the test and you will be able to see the score. If you wish, you can also alternatively reset the test in case you want the candidate to take it again (for example, if it expired due to an internet connection problem or the candidate had to leave the test for external reasons).

Yes, it is possible. To define a deadline for testing a process, you must:

1. In the process configuration, in the “Expires” section, place the date and time when the process will expire. After this, the links sent to the candidates will not work and a message will indicate that the test is no longer available.
2. Click on the “Save” icon, located on the right.

After the date indicated, candidates will no longer be able to access the test.

Yes, this is possible by using the option to upload candidates via a CSV file. To upload candidates from a CSV file, you must:

1. In the process settings, in the “Candidates” section, click on the option “Choose candidates”.
2. When the box for selecting candidates appears, click on the “Upload CSV file” button.

Note:

To upload a CSV file, it must be separated by commas and have the following structure:

Column A -> Email, Column B -> First name, Column C -> Last name.

Example:

pedro@example, Pedro, Gomez

alfredo@mimail, Alfredo, Perez

3. Click on the “Upload” button, and select the file containing the candidates.
4. Make sure that all candidates are uploaded successfully.
5. Click on the “Select” button to save your changes.

The candidates will be available to add to your selection processes from the process settings, with the option to Choose Candidates.

Evalart implements various systems to prevent candidates from cheating. Although it is not possible to avoid all cases, several possible forms of cheating are detected and in case one of your candidates has a suspicious behavior, we will contact you to indicate the particular case.

We cannot make public the methods Evalart uses to detect fraud attempts as this would make it easier to avoid them, but we constantly evaluate and refine these measures.

Yes, it is possible to remove candidates from an ongoing selection process, but only if it does not have test instances created. To do so, you must:

1. On the Evalart home page, select the option “Selection Processes”, located on the top menu.
2. Click on “Processes list”.
3. When you enter the process list, click on the key icon located to the right of the process you want to modify.
4. When accessing the configuration menu, in the “Candidates” section, click on the “Options” button, located to the right of the candidate you wish to delete. The candidate is removed from the process, but not from the candidate database.
5. Click on “Delete”.

1. On the Evalart home page, click on the “Reports” option, located on the top menu.
2. Click on “Ranking of candidates by process”, to see the list with the ranking of each one of the candidates.
3. Select the process whose candidate ranking you wish to see.

The report creates a score automatically based on an average of the tests answered by the candidate. The weight of each test can be modified from the process configuration by clicking on the option button for the test for which you want to change the weight.

If the score bar is grey, it is because the candidate has not yet answered all the tests.

It is also possible to assign a subjective score with a range of 1 to 5 stars, in which case the report will sort by that column (but it is possible to sort by any question by clicking on the header of the field you want to sort by).

1. On the Evalart home page, click on the “Reports” option, located on the top menu.
2. Click on “Process result summary”.
3. Select the process whose process result summary you want to see.

The tabular report lists all candidates and the scores obtained on each test. By clicking on the score it is possible to view the detailed report for that test. By clicking on the magnifying glass it is possible to see the candidate’s file.

Evalart has both separate reports for each test the candidate answers, as well as a summary report that includes the results of all tests for a candidate in a selection process. To access this report:

1. Go to the Reports menu => Process summary result
2. Go to the Results view
3. In the list, at the far left of each row, there is a magnifying glass icon. Clicking it opens the summary report with the results of each test for the candidate in that process.

This report is also configurable by clicking on the report options menu, option Configure Report. Also note that the report format that will be applied to the selection process can be configured when creating or editing a process (In the Results Report field, in the advanced options in the process data edition).

To see the score of a test that still indicates the state “in process”, you must force the calculation. To force the calculation, you must:

1. On the Evalart home page, click on the “Reports” option, located on the top bar.
2. Click on the option “View submitted tests”.
3. Click on the check icon located to the right of the test “in progress”. Clicking on the check icon will force the calculation of the test and you will be able to see the score.

This can happen if the candidate closed the browser and did not click on finish. It is advisable to confirm with the candidate to know if they had any problem in which case it might be advisable to reset the test so that they can take it again.

By default it arrives to the mail of the user who sent the tests, but it is possible to configure a generic mail so that the answers to the mails arrive to this mail. To do this you must enter the menu User => Manage Account Options and enter the email in the Generic Email field. Then in the user configuration (User menu => Configure User) check the option “Use generic email” so that all emails with tests sent by this user when answered will arrive to the generic email configured in the account.

Only account users have access to the candidates’ information and the results of the candidates in the account, unless the “Show Score at the End” option is checked when setting up the process, which by default is always set to no. If the option “Show Score at the End” is checked, the candidate will be able to see their own test score at the end.

This is possible thanks to the “Execute Questionnaires” option. To access this option, you must:

1. Go to the process configuration where the test you want to run is.
2. Place the candidate in the process configuration panel, and click on the “options” button, located to the right of the candidate.
3. Click on the “Execute Questionnaires” option.
4. Click on the “play” icon, located to the left of the test you want to run.
5. When the confirmation notice appears, check the information and click “accept”. You will be automatically logged out of the administrator module and the test will start, so that the candidate can take the test on that same computer.

Sometimes the test invitation mail may not reach the candidate (either by mistake when entering the mail or by going to the spam folder or simply some other problem).

The first step if a candidate indicates that they did not receive the mail is to check that the mail address is spelled correctly and that the mail did not go to the spam folder (in which case the candidate should be asked to mark the mail as spam). To forward the mail with the links to the tests to a candidate, go to the process configuration (go to the “Selection Processes” menu, select “Process List” and click on the process wrench where the candidate is). At the bottom right, where the candidates are listed, select the option “View/Send Tests” where you can resend the invitation to the same registered mail of the candidate or to another mail by clicking on the resend button.  Alternatively, you can obtain from this same screen the links to the tests to resend them by other means. To do this, click on the clipboard icon and then paste it into the media where you want to copy it (such as your own mail system or some chat system).

If you are sending the mail to internal emails of your company and none arrives, consult with the mail administrator to ensure that emails sent from Evalart are accepted.

The platform allows you to evaluate a candidate on the same computer where you work with Evalart as a recruiter. However, for security reasons, the platform will automatically disconnect them from the administration module when they do so. Do not try to open a test link directly if you are in the administration module as this is not allowed for security reasons. To run a test for a candidate on your computer you must follow these steps:

1. Go to the configuration of the process for which you want to perform the evaluation (go to the Selection Processes menu, select “Processes List” and click on the wrench corresponding to the corresponding process).
2. In the list of candidates shown in the process configuration (on the right side) identify the candidate you want to evaluate and click on the menu next to the candidate.
3. Choose the “Execute Tests” option.
4. The tests listed are shown with a small button with the play symbol (triangle).
5. Click there when the candidate is ready to give the test. This will disconnect the administrator user and run the test for the candidate.

To correct the mail, name or other data of the candidate you have to go to the “Selection Processes” menu and choose “Candidates List”. From there you can directly modify the listed fields or you can click on the pencil and edit from there all the fields of the person’s record.

In case the modification is to correct the mail for a candidate with tests already sent, to resend the mail with the links to the tests to a candidate, go to the process configuration (go to the “Selection Processes” menu, select “Process List”, and click on the process wrench where the candidate is). At the bottom right, where the candidates are listed, select the option “View/Send Tests” where you can resend the invitation to the same registered mail of the candidate or to another mail by clicking on the resend button.

Evalart allows you to restrict access to the selection processes used by previously created user groups in the “manage user groups” section. When restricting a process to a group, only that group will have access to the process (besides any administrator user). If you do not specify a group, all users in the account will have access to the process.

1. Go to the “processes list” section by expanding the “selection processes” menu, located in the main menu, and selecting “processes list”.
2. Locate the process whose access you wish to restrict to a group of users.
3. Edit the process by clicking on the pencil icon located on the right side of the process.
4. Expand the “advanced options”, locate the field “restricted to group” and select the group that will have access to the process.
5. Save.

Web monitoring helps reduce the risk of fraud during the assessment by taking photos at intervals which are then compared to the candidate’s registration photo. Using artificial intelligence, it is verified that it is always the same person takingthe test and that there is no other person helping.

The activation of the web monitoring is done from the process configuration screen. For this you must enable the following options (found within advanced options):

In Photo Required select Yes or Optional.
In Webcam Monitoring, select Yes or Optional.

If you indicate optional, the candidate can choose to do the test without monitoring, but if you enter Yes, the candidate will only be able to take the test if he or she has a webcam and enables it.

The artificial intelligence verification of the test is done within the hour once the test is finished. In case of finding something strange, you can verify the photos manually (in case the artificial intelligence does not detect anything strange, the photos are not displayed for review)

Evalart’s 360 assessments allow for evaluations where a person can be evaluated by their supervisor, peers, subordinates, third parties such as internal or external clients, and even be self-evaluated.

Evalart has ready-to-use 360 assessments (found in the catalog in the “Surveys” family, Performance Evaluation, and “360” subfamily). These tests can be used directly or also be cloned to generate a variant, adding or removing questions or areas to be evaluated. It is also possible for the user to create a complete 360 assessment from scratch, in the same way that other tests are created on the platform.

• The first step to creating a 360 evaluation is to create a new process (from the Selection Processes menu => New Process). 

Note: In Evalart it is possible to perform two types of 360 evaluations; the first is 360 with general evaluators when the same people always evaluate all those being evaluated; and the most usual, which is 360 with personal evaluators, where it is necessary to specify for each person who will be their evaluators.

• After filling in the general data of the process, you must select the 360 assessment to be used (with the test button in the process configuration view). The next step is to add the people to be assessed, which can be created manually, uploaded from a file, or chosen from the candidate database.
• If the evaluation is type 360 with general evaluators, in the options menu next to the test, you will find the option to define the evaluators (which would apply to all the test takers). But, if the evaluation is type 360 with personal evaluators, you will have to define the evaluators for each assessee (through the options menu next to the candidate, choosing the option to configure evaluators).

Note: In both cases, the evaluators can be chosen from the candidate database list on the platform and must indicate the relationship to the assessee (e.g., if the assessee is the supervisor) and check the self-evaluation box if you want the assessee to self-evaluate.

• With the invite candidates button, e-mails will be sent to the evaluated and the evaluators to answer the survey. Once all of a person’s evaluators respond, it will be possible to view the 360 evaluation results, which will show the scores by each evaluated area and by the type of evaluator (self-evaluated, supervisor, peer, subordinate, or other).

Note: From the point of view of the consumption of tests in the recurrent or pay-as-you-go plan, one test is deducted for each person evaluated with the 360 questionnaire (regardless of how many people evaluate it).

The user can customize the email sent to the candidate by following the steps described below:

If the user is in the process configuration,

1. Click on the “edit mail” button located on the right side in the “candidates” section.
2. Make the desired customizations to the email.
3. Save the changes with the “save” button.
4. In addition, the user can open the email preview and/or save it as a template to be used in other processes using the “save and preview” and “save template” buttons.

If the user is outside the process configuration,

1. Display the list of options for “selection processes” and select the “process list” option.
2. Once in the list, access the configuration by clicking on the key button located to the right of the process whose mail you wish to modify.
3. Click on the “edit mail” button located to the right in the “candidates” section.
4. Make the desired customizations to the email. Here the user can load saved templates, modify the formatting, and/or insert dynamic text.
5. Save the changes with the “save” button.

In addition, the user can open the mail preview and/or save it as a template to be used in other processes using the “save and preview” and “save template” buttons.

Evalart has several controls to detect cases where a candidate might have cheated. When a test is flagged as possible cheating (a red triangle appears in the test listing) it means that Evalart has detected suspicious activity. This does not necessarily mean that the candidate cheated, but that there is an increased risk and, therefore, it is necessary to take this into account when determining whether to consider the test as valid.

To see the detail of what caused the alert,

1. You must go to the detailed test report (by clicking on the magnifying glass in the list of submitted tests or on the score if viewing the tabular score report).
2. Already in the detailed test report view, in the first section of the report, in case of a suspicious situation, a text indicating the fraud risk, the risk level, and a question mark will appear. Clicking on the question mark will display more information about what triggered the alert. For example, if a different person was detected taking the test in the web monitoring, you will see the suspicious photos. 
3. In case of detecting similar code between two candidates in a programming test, both codes can be compared to decide if it is possible plagiarism.

As mentioned above, it is important to note that in no case does the alert indicate with 100% certainty that the candidate cheated, but a higher risk compared to a test that was not flagged. 

It is possible to create multiple users within an Evalart account. To create a new user, go to the User menu and choose the Manage Users option. From there, it is possible to create (and also modify or delete) users on the platform. You can define whether the user is an administrator or not (only administrators can create users, and some restrictions such as user groups do not apply to administrators). The creation of users is free of charge, and there are no limits to the number of users that can be created.

Note: By default, all users can view and edit all information related to the account (candidates, processes, customization, etc.). It is possible to apply restrictions using the User Group and/or User Roles functionality. 

With “User Groups” you can restrict the access to selection processes using previously created user groups. 

With “User Roles” you can restrict the access of other users to certain entities such as tests, processes, result reports, etc. This restriction can be read-only, full access, or no access.

Pre-recorded interviews allow the candidate to record the answers to questions in video format (up to 2 minutes per question). Video questions are created like any other question on the platform and can be added to any test. It is also possible to create a test consisting only of these questions for a complete interview of pre-recorded video questions.

Pre-recorded interviews allow you to get to know the candidate and capture not only what they say but also their expressions and attitudes. Additionally, this type of questioning is excellent for evaluating aspects, such as presentation skills and level of English (or other languages) for any position that benefits from expressing orally in an effective way. Another advantage of this format is that it is handled like a structured interview where candidates answer the same questions in the same order and under the same conditions, resulting in a fairer and more effective evaluation process.

To create a test of this type, use the option to create a new test and, with the “add questions” button, you can add the questions (making sure to select video questions as the question type). The question itself is a text question, with the answer being a video recorded by the user at the time of answering.

The video questions must be evaluated manually. To do this, the evaluator (or evaluators) must go to the list of tests once the candidate has finished the test, and, by using the pencil button, they must access the test edition, where they will be able to see the videos and place a score.

Note: For all purposes, tests containing pre-recorded video questions are counted as a test to be deducted from the active bag or plan.

We are working to automate the process of generating and sending invoices, but for the moment, please contact us by any means (mail, online chat, or phone) to request delivery.

Programming questions are created in the same way as other question types, but a specific tool is available to facilitate the creation of this type of question and to place specific values for programming questions.

To access this tool, go to the “Tools” menu and select “Programming Question Builder”. After loading the question, the corresponding information will be displayed. 

On the right side, there is an editor where you can test how the question would evaluate an answer, and, on the left side, there are the conditions (validation scenarios) to validate the question, which is composed of two sections; the first one that is used to validate the question when the candidate is answering and the ones that will be used to validate and determine the score of the question. This difference exists to prevent the candidate from entering a trivial answer such as “Print 5” instead of an algorithm to solve the question problem. This is why it is usual to include predefined code, one to validate during the exam and another to assign the score (with other values) so that the candidate cannot enter a trivial answer without the corresponding logic.

For both validation during the test and for scoring, you need to enter the expected value, which you can enter directly, or you can write a program to test the question and then copy the output from it to the answers. You can run your program with any of the conditions by clicking the corresponding Run button. The conditions to validate weight since it is possible to place several different conditions, each with a different weight that indicates how much weight this condition has in calculating the score obtained by the candidate in the question.

Optionally, you can set up a code efficiency evaluation, based on the number of instructions (tokens) used by the program. This is to give less score to solutions that are longer than necessary. For this, you must fill in the Min Token, Max Token, and Code Efficiency Weight fields. Code Efficiency Weight refers to what percentage of the question score will depend on the coding efficiency. For example, if the question has a score of 20 and a weight of 50, then 50% of the score (10) will depend on the efficiency. The code is evaluated and, if the number of tokens is less than or equal to the Min token, it will get the maximum score for efficiency. On the other hand, if the number is greater than the Max token, it will receive 0. It is advisable to configure this only when you already have a sample of several candidate responses to identify reasonable ranges of the Min and the Max Token (when executing the candidate response in the constructor, the Min and Max token values for the executed code are shown).

Finally, for questions that support measuring code performance, it is possible to indicate the ranges and the performance weight in the question score. It is necessary to mark which validation scenarios will be used to measure performance. Currently, only questions that use the TLang module allow performance to be measured.

With Evalart, you can conduct remote structured interviews in which you provide candidates with a series of questions that they must answer. You can optionally define one or several evaluators so that each of them evaluates each question and obtains an average score for each one.

You can use the structured interviews from the catalog or create your own. Structured interviews are handled as another test, and you can create them as a test. Just keep in mind to use open-ended questions, such as text questions with multi-line text responses, and check the manual scoring option for each question.

Add the interview to your selection process in the same way as you do with a test. Optionally, you can define evaluators, in the process configuration view by going to the options menu next to the test, selecting “Configure Evaluators”, and choose the users you want to evaluate the test.

Once the candidate answers the interview, each evaluator can go to the reports menu to score it. The interview will appear as a test, indicating that it requires manual scoring. By using the pencil icon to open the interview, each evaluator will be able to score each question. The test will be in “completed” status when all questions have been scored (either by all evaluators or at least one, depending on what has been configured).

Note: Structured interviews, like a regular test, deduct one test from the plan.

Evalart has an Applicant Tracking system that you can use if you do not currently have one. To access this module, go to the Reports menu => Process Result Summary and click on the Process Flow button. In this module, you can drag the candidates to the different stages of the process or even create your own stages (such as “Interview with Manager”). To configure the flow, click on the Configure Process Flow button. 

The defined flows can be used in other processes by choosing one of these as the flow to be used when creating or editing a process (within the advanced options). It is also possible to define other states to associate with the candidates.

To modify a test from the Evalart test catalog, it is necessary to clone it first. To clone a test you must follow these steps:

1. On the main page of https://questionnaire.evalart.com/admin/, go to the test menu and select the “Test List” option.
2. Locate the test you wish to modify and click the button with the magnifying glass icon.
3. Click the “Clone” button and select the language and the elements to be cloned with the test (questions, categories, category group and/or ranges).
4. The system will automatically take you to the test you have just cloned, which you can now edit. Make the desired changes.
5. Click the “save” button. When you save the test, a box will appear asking if you want to go to the test builder, where all the questions that make up the test are located and from where you can modify, remove or add questions. If you select “accept”, the system will take you to the builder; but, if you select “cancel”, the system will take you to the test list.
6. If you selected “accept” and made changes, you must click the “save” button to save the changes.

How to create a new test from scratch?

When creating a test it is necessary to follow the series of steps explained below.

FIRST STEP: create the questions

In Evalart, you can create your own questions or use existing questions. If you want to use existing questions, skip this step.

To create your own questions:

1. On the main page of https://questionnaire.evalart.com/admin/, go to the test menu and select the option “Questions” and the system will automatically take you to the list of questions, from where you can create a new question.
2. In the list of questions, you will find two options for creating questions. The first option is to click the “New” button to create individual questions (text, image, programming, etc.) and their alternatives (which can be text or image); and the second option is to click the “paste questions” button, from where you can create several questions at once.

Note: If you choose to paste questions, use “Q:” for the question and “A:” for the alternatives. Mark the correct answer(s) with an asterisk. Additionally, you can indicate the time, score, and difficulty by using “T:” for time (if omitted, the platform assumes 1), “S:” for score (if omitted, the platform assumes 10), and “D:” for difficulty level by placing the value on a separate line (use 1 for easy, 2 for medium, and 3 for difficult. If omitted, the platform assumes medium). Example:

Q:
Which number is a prime?
A:
4
5 *
6
8
T:
1
S:
10
D:
1

STEP TWO: create the test

1. Go to the “Test” menu and select the “Test List” option. In the list of tests, click the “New” button.
2. After clicking the “New” button, a screen will appear with several fields to be filled in, such as name, description (which will NOT be visible to the candidate), visible description (which will be visible to the candidate), level of difficulty (easy, medium, or difficult), time limit, day limit, language, score ranges (the range will help you add more information about the candidate’s score), type, family, subfamily, and results report (the format in which the test results report will be shown).
3. When you have added all the information about the test, click the “Save” button and the system will automatically take you to the test builder, from where you can select the questions to be shown on the test.

STEP THREE: Adding questions from the test builder

1. To include a question in the test, you must take it with the mouse, drag it to the “selected questions” field and drop it.
2. After including all desired questions, click the “save” button to save the changes.
3. To test that everything is in order, you can click the button with the eye icon. This option will allow you to view the test as the candidate will. When you finish the test, you can simply finish or finish but keep instances (this will allow you to save the results report).

STEP FOUR (OPTIONAL): Create a score table

Scoring tables allow you to define a description to be added to the test results based on the score. For example, to indicate that a score of 0 to 20 would mean a low level of knowledge.

1. On the main page of https://questionnaire.evalart.com/admin/, in the “Settings” menu, select the option “Tests” followed by “Score table”.
2. Click the “New” button to create a new score table, and fill in the necessary fields (name, description, etc.)
Save the changes by clicking the “Save” button. When you save, the platform will automatically take you to the score range screen.
4. Click the “New” button to create a range. The number of ranges to be created will depend on the number of skill levels you wish to add. When creating a range, you must indicate the initial score and the final score for the range. For example, if you have a 200-point test and you want to add 4 ranges (low, medium, high and very high), the first range (the lowest) would start at 0 and end at 50.
5. After creating all the ranges, you can go to the test to which you will apply the table (in case you have already created it) and, in the field “score ranges”, select the table you have just created and save the changes.

Evalart users can add randomized questions to their tests by following the steps below:

1. In the test constructor, after adding all the desired questions, select the “tools” tab and click the “add random” button.
2. After clicking the “add random” button, two new elements will appear in color red, these elements will mark the beginning and the end of the group of questions from which the system will take the questions. You must drag and drop these elements into the “selected questions” field, as you would when adding a question to the test, in order to add the randomness tool to the test. Note: It is important that you place the elements at the beginning and at end of the question selection to which you want to add the randomness.
3. After adding the items to the question selection, specify the number of randomized questions you want to be shown on the test in the field that is set to 0 in the corresponding the “beginning” item. For example, if we have a selection of 10 questions and we want the system to choose only 5 of those questions at random, we would have to place 5 of 10.
4. Finally, save the changes by using the “save” button.

NOTE: These steps apply to both new and existing tests. However, if you want to add the randomness to an existing test in the catalog (that you did not create), you must clone it before performing the series of steps described.

1. On the main page of https://questionnaire.evalart.com/admin/, go to the test menu and select the option “Questions” and the system will automatically take you to the list of questions, from where you can create a new question.
2. Click the “paste questions” button, from where you can create several questions at once.

Note: If you choose to paste questions, use “Q:” for the question and “A:” for the alternatives. Mark the correct answer(s) with an asterisk. Additionally, you can indicate the time, score, and difficulty by using “T:” for time (if omitted, the platform assumes 1), “S:” for score (if omitted, the platform assumes 10), and “D:” for difficulty level by placing the value on a separate line (use 1 for easy, 2 for medium, and 3 for difficult. If omitted, the platform assumes medium). Example:

Q:
Which number is a prime?
A:
4
5 *
6
8
T:
1
S:
10
D:
1

3. Click the “create questions” button. A prompt will then appear indicating whether your questions were successfully created or whether there was an error in the format.

Yes, this is possible by creating a question with an open text answer. To create aquestion with open text answer:

1. On the main page of https://questionnaire.evalart.com/admin/, go to the test menu and select the option “Questions”, and the system will automatically take you to the list of questions.
2. Click the “New” button to create a new question.
3. In the “Type” field, select the option for a text or image question with a single or multiple line open text answer.
4. After selecting the question type, a new field will appear in which you can enter the valid answer. NOTE: It is important to note that this field is case sensitive. Therefore, it is recommended that you enable the “Manual Score Only” option so that you can review the candidate’s answer before assigning a grade. To review them, you must enter the results report, click the magnifying glass icon, locate the question you want to review, and finally assign a grade.
5. Click the “Save” button.

Yes, this is possible by using the picture question option as a test type. For this you must:

1. On the main page of https://questionnaire.evalart.com/admin/, go to the test menu and select the option “Questions”, and the system will automatically take you to the list of questions.
2. Click the “New” button to create a new question.
3. In the “Type” field, select the option for a single/multiple choice image/text answer or open text answer.
4. After selecting the question type, a new field will appear in which you can upload the image you want to display as the question.
5. Save the question using the “Save” button. If you have selected a single/multiple choice text/image question (not applicable for image questions with open text answer), the system will automatically take you to the alternatives creation screen where you can enter the text or image alternatives.

Score tables help us to better name and describe a candidate’s score on a test. The range and description will be shown in the results report along with the score obtained. In addition, it is also possible to create score tables that apply to categories and groups of categories.

To create your own score tables:

1. On the main page of https://questionnaire.evalart.com/admin/, in the “Settings” menu, select the option “Tests” followed by “Score table”.
2. Click the “New” button to create a new score table, and fill in the necessary fields (name, description, etc.)

Save the changes by clicking the “Save” button. When you save the changes, the platform will automatically take you to the score range screen.

4. Click the “New” button to create a range. The number of ranges to be created will depend on the number of skill levels you wish to add. When creating a range, you must indicate the initial score and the final score for the range. For example, if you have a 200-point test and you want to add 4 ranges (low, medium, high and very high), the first range (the lowest) would start at 0 and end at 50.
5. After creating all the ranges, you can go to the test to which you will apply the table (in case you have already created it) and, in the field “score ranges”, select the table you have just created and save the changes.

This is possible by using the preview option, whose button has the drawing of an eye. By using this option, you can see the test as the candidate would. You can find the preview option in two places: the test builder and the test list.

To enter the preview from the test builder:

1. After you have added all the questions to the test you have just created and saved your changes with the “Save” button, click the eye icon button at the top of the test builder.
2. Click “start test” and then “start”, and take the test as the candidate would.
3. When finished, you can choose to finish or finish but keep the instance. If you select “finish but keep instance”, the platform will register your test and you will be able to review the results report by clicking the “Reports” menu and then clicking the “View Sent Tests” option.

To access the preview from any other section of Evalart

1. Go to the test menu located on the main Evalart bar and select the “Test List” option.
2. In the test list, locate the test you want to test and click the button with the eye icon.
3. Click “Start Test” and then “Start”, and perform the test as the candidate would.
4. When finished, you can choose to finish or finish but keep the instance. If you select “finish but keep instance” the platform will register your test and you will be able to view the report of your results by clicking the “Reports” menu and selecting the “View Sent Tests” option.

In Evalart, users can use existing reports, customize an existing report or create their own reports.

If you want to customize a report:

1. On the main page of https://questionnaire.evalart.com/admin/, go to the “Configuration” menu located on the main menu bar of the platform and select the option “Tests” followed by “Result Report Types”.
2. Locate the report you wish to customize and click the button with the wrench icon to access the report options. If you do not have the necessary permissions to edit the range, you must clone it first.
3. In the report options you can add sections and make changes such as modifying the font type, choosing which elements you want to appear in the report header, choosing which information you want to be shown in the report, changing the color of the bars, etc.
4. After making all the desired changes, save them by using the “Save” button.

If you want to create your own report:

1. On the main page of https://questionnaire.evalart.com/admin/, go to the “Settings” menu located on the main menu bar of the platform and select the option “Tests” followed by “Types of results report”.
2. Click the “New” button to create a new process.
3. In the report options you can load your own reports, add sections, choose the type of font, the elements and information you want to appear in the report, change the color of the bars, etc.
4. After making all the changes, save them using the “Save” button.

It is possible to enable questions that allow applicants to attach files (From images, text, zip or video) during the test. Only text answer questions allow candidates to attach files during the test. For this, in the question editor, check the option “Requires attachment”). The files that the applicant attaches will be visible in the results report view or in the results edit view.

In Evalart it is possible to create questions that include downloadable files, that is, complementary material that the applicant can download. To attach files to a question, you must edit the question and in the advanced options section attach the files you want to add. The applicant can download them during the test.

Evalart allows you to edit the score of any test answered by a candidate. This is useful if it is determined that the candidate should receive a different score than the one assigned by the system.

This can occur, for example, in programming tests if the candidate wrote a program that is generally OK but does not print the answer exactly as expected (different from what is asked for in the question), in which case the system will assign zero, but the evaluator may want to give a partial score. This option is also used for manually corrected questions.

To manually edit an answered test, click on the pencil icon in any results list (such as the answered test report). This will open a view of the test to be edited.

To change a score, select the question and then click on the pencil icon in the field labeled “Manual Score”. It is also possible to edit the description of the score and even, if desired, to modify a candidate’s written answer (for example, if you consider that they made a minimal error and want to verify this by directly correcting their answer). In these cases, the candidate’s original answer is saved and restored if necessary.